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CHAPTER  I 


INTRODUCTION  AND  OVERVIEW 

The  last  decade  has  introduced  a  bewildering  era  of 
complexity  in  Department  of  Defense  (DOD)  weapon  system  acqui¬ 
sitions.  While  primary  concern  has  centered  on  the  effective 
and  efficient  use  of  taxpayer  dollars,  numerous  obstacles 
make  this  objective  deceptively  difficult  to  achieve. 
Tremendous  leaps  in  technology  have  produced  weapon  systems 
of  previously  unimaginable  complexity  and  cost.  Further  com¬ 
plicating  the  issue  is  the  need  to  plan  the  acquisition  and 
use  of  these  weapon  systems  over  as  much  as  a  20-year  time 
span  with  money  that  is  appropriated  by  Congress  one  year  at 
a  time.  Even  more  uncertainty  has  been  added  by  shocks  to  the 
U.S.  economy  in  the  form  of  1)  inflation,  2)  increasing  cost 
and  questionable  availability  of  energy,  and  3)  increased 
competition  from  foreign  countries. 

The  above-mentioned  conditions  have  contributed  to  cost 
overruns  in  U.S.  Air  Force  weapon  system  acquisitions,  and 
clearly  illustrate  the  need  for  more  precise  techniques  to 
estimate  the  cost  of  these  weapon  systems.  The  experience  of 
industry  and  the  DOD  indicates  that  direct  labor  is  a  signifi¬ 
cant  determinant  of  cost.  This  research  will  focus  on  develop 
ing  a  better  way  to  estimate  direct  labor  costs  and,  more 
specifically,  on  the  effect  of  a  change  in  the  rate  of 
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production  on  direct  labor  requirements. 

Limiting  the  Problem 

At  the  outset  of  a  major  OOD  production  program,  a  ten¬ 
tative  monthly  production  schedule  for  the  life  of  the  program 
is  negotiated  between  the  contracting  parties.  This  schedule 
permits  planning  for  such  items  as  work  force  buildup,  facility 
and  tooling  needs,  and  the  ordering  of  long  lead-time  items. 
Although  the  planning  delivery  schedule  covers  the  life  of  the 
program,  formal  contractual  agreements  between  the  Department 
of  Defense  and  manufacturers  usually  cover  only  annual  deli¬ 
very  requirements.  Delivery  requirements  for  subsequent  years 
are  funded  through  the  exercise  of  options  or  separate  con¬ 
tracts  as  funds  are  appropriated  by  the  Congress  (IS: 2). 

These  multiple-year  programs  may  result  in  a  need  to 
change  the  production  rate.  For  example,  when  funding  for  a 
particular  year  is  insufficient  to  cover  the  production  sche¬ 
duled  under  an  existing  production  plan,  it  may  be  necessary 
to  stretch  out  the  production  over  a  longer  time  span.  A 
national  emergency  or  changed  mission  requirement  may  dictate 
an  accelerated  rate  of  production.  When  such  changes  in  deli¬ 
very  schedules  are  required,  changes  in  cost  estimates  are 
also  required  to  support  contract  negotiations  and  additional 
funding  requests.  It  is  suggested  that  the  rate  of  production 
is  an  important  independent  variable  that  can  be  used  to  help 
project  the  change  in  costs  due  to  either  program  accelerations 
or  decelerations  (15:2). 
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Industrial  and  government  cost  estimators  have  tradi¬ 
tionally  used  learning  curve  techniques  to  estimate  direct 
labor  hours  required  in  production  (3:25).  Learning  curve 
theory  is  derived  from  the  relationship  between  the  cumulative 
number  of  units  produced  and  the  number  of  direct  labor  hours 
required  for  production.  In  other  words,  as  a  worker  produces 
more  of  a  given  item,  a  certain  amount  of  "learning"  occurs, 
and  the  number  of  hours  required  for  production  tends  to 
decrease  in  a  regular  pattern.  This  "learning"  is  not  limited 
to  improved  manual  dexterity  of  workmen.  Other  forms  of 
learning  include  experience  gained  by  managers  that  results 
in  improved  work  methods,  more  efficient  physical  layout  of 
the  shop,  more  efficient  parts  supply,  more  efficient  tools, 
etc.  These  forms  of  learning  all  result  from  experience 
gained  from  working  with  a  system,  and  have  led  some  authors 
to  suggest  that  the  learning  curve  should  really  be  called  the 
experience  curve  (14:63-64).  Learning  curve  theory  is  based 
on  the  following  assumptions: 

1.  The  production  item  should  be  sizeable  and  complex 
and  should  require  a  large  amount  of  direct  labor. 

2.  The  majority  of  assembly  operations  should  not  be 
mechanized  or  machine-paced. 

3.  Learning  curves  applied  from  past  experience  should 
be  adjusted  for  any  differences  in  items,  process,  or  other 
aspects  of  production. 

4.  The  production  process  should  be  a  continuous  one 
and  the  item  and  product  changes  kept  to  a  minimum. 


5.  Historical  data  should  be  available  to  compute  the 
curve  since  estimated  data  have  low  reliability. 

6.  There  should  be  no  external  production  rate  changes 
(3:231) . 

The  last  assumption  (no  externally  caused  changes  in 
production  rate)  is,  as  already  indicated,  unrealistic  in  the 
DOD  arena.  Changes  in  production  rate  are  forced  on  DOD  acti¬ 
vities  quite  often.  There  has  been  considerable  research  con¬ 
ducted  to  correct  this  apparent  limitation  of  the  standard 
learning  curve  model.  These  studies  will  be  discussed  in 
Chapter  II. 

One  of  the  most  promising  studies  resulted  in  a  model 
for  airframe  production. developed  by  Larry  L.  Smith,  which  im¬ 
proved  the  basic  learning  curve  model  through  the  addition  of 
a  production  rate  variable.  Smith's  methodology  has  been  re¬ 
plicated  for  aircraft  avionics  and  engines  to  determine  its 
validity  in  other  types  of  production.  Further  replication 
in  other  weapon  system  applications  is  warranted,  and  forms 
the  basis  of  this  research  effort. 

Research  Problem  Statement 

The  effect  of  changes  in  the  production  rate  on  direct 
labor  hours  for  continuing  missile  production  programs  is  not 
known. 


Research  Objectives 

The  objective  of  this  research  is  to  apply  Smith's  model 
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to  determine:  1)  if  changes  in  production  rate  affect  total 
direct  labor  hours  per  missile;  2)  how  the  model  compares  with 
the  basic  learning  curve  model  as  a  predictor  of  direct  labor 
hours  for  continuing  missile  production;  and  3)  if  Smith's 
approach  for  airframe  production  is  applicable  to  missile 
production. 


Research  Hypotheses 

The  hypotheses  to  be  tested  in  this  research  are:  1) 
that  the  production  rate  explains  a  significant  amount  of  the 
variation  in  direct  labor  requirements  for  missile  production, 
and  2 )  that  the  production  rate  model  is  a  better  predictor  of 
direct  labor  requirements  than  the  basic  learning  curve  model. 

Summary 

With  the  problem  narrowed  and  the  objectives  outlined, 
the  next  chapter  is  devoted  to  a  review  of  past  research 
approaches  and  findings.  Chapter  III  will  discuss  the  research 
hypotheses  and  the  methodology  for  testing  these  hypotheses. 

A  brief  summary  of  assumptions  and  limitations  about  methodo¬ 
logy  will  close  Chapter  III.  Chapter  IV  will  discuss  data 
analysis  and  evaluation.  Finally,  Chapter  V  will  contain  the 
summary,  conclusions,  and  recommendations  of  this  research. 
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CHAPTER  II 


A  HISTORY  OF  LEARNING  CURVE  THEORY  AND 
ITS  USE  IN  PREDICTING  LABOR  HOUR 

requirements 

The  learning  curve  has  been  used  extensively  in  the 
aircraft  industry  during  the  last  thirty  years  to  assist 
in  cost  estimating  for  major  DOD  weapons  acquisition 
programs.  Since  the  introduction  of  the  basic  learning 
curve  model,  a  number  of  variations  have  been  developed 
in  an  attempt  to  achieve  a  greater  accuracy  in  predict¬ 
ing  actual  cost  figures  [6:6], 

Since  the  standard  learning  curve  model  forms  the  basis  for 

all  variations  that  followed,  this  chapter  will  first  discuss 

the  original  model  and  its  limitations.  Then  a  chronology  of 

the  major  research  efforts  that  resulted  from  the  traditional 

model  will  follow. 

Standard  Learning  Curve  Model 

T.  P.  Wright  is  generally  regarded  as  the  pioneer  of 
learning  curve  theory.  After  his  initial  research,  learning 
curve  tables  were  in  use  at  McCook  Field,  Dayton,  Ohio  as 
early  as  1925  (4:49-50).  Wright's  1936  article  on  the  applica¬ 
tion  of  the  learning  curve  to  aircraft  manufacturing  cost 
estimation  is  widely  regarded  as  the  initial  substantive 
effort  in  mathematically  modeling  the  learning  phenomenon  for 
aircraft  manufacturing  (17:2DZ6).  As  a  result  of  increased 
aircraft  production  during  World  War  II,  the  U.S.  Government 
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sponsored  a  statistical  analysis  by  the  Stanford  Research 
Institute  on  World  War  II  airframe  direct  labor  data.  The 
Stanford  study  resulted  in  two  important  achievements :  1)  it 

confirmed  the  learning  curve  effect  on  World  War  II  production 
and  2)  it  demonstrated  the  value  of  a  learning  curve  model  for 
use  in  cost  analysis  (17 : 2D26- 27) . 

It  can  be  intuitively  discerned  that  for  labor  pro¬ 
duction  processes  which  are  repetitious,  each  succes¬ 
sive  equivalent  unit  of  production  will  require  fewer 
direct  manhours ,  and  that  the  manhours  required  decrease 
at  a  decreasing  rate.  This  phenomenon,  known  as  the 
learning  or  experience  curve,  has  two  basic  variations. 

The  variation  validated  by  the  Stanford  study  is  known 
as  the  "unit  curve"  or  "Boeing"  theory  (11:2D28;  7:273), 
and  can  be  expressed  mathematically  by  the  formula: 

Y  -  AXb 


where: 

Y  represents  the  direct  labor  hours  for  the  "xth" 
unit, 

X  represents  the  total  number  of  units  manufactured 
in  the  process, 

A  represents  the  number  of  labor  hours  to  produce 
the  first  unit  manufactured  in  the  process,  and 
B  represents  the  slope  parameter  or  a  function  of 
the  improvement  rate. 

The  slope  of  the  curve  can  be  expressed  as  a  percentage, 
which  is  the  ratio  between  the  per  unit  cost  at  any  unit 
and  the  percent  cost  at  double  that  number  of  units  (2: 
199) .  The  "cumulative  average"  or  "Northrop"  variation 
(described  by  Wright  in  his  1936  article)  measures  the 
average  cost  for  X  units  rather  than  cost  for  the  xth 
unit.  Its  mathematical  form  is: 

7  -  AXB 

"Where  7  is  the  cumulative  average  cost  of  all  production 
up  to  and  including  the  xth  unit.  The  other  parameters 
are  the  same  as  for  the  unit  curve  theory  [11:2D29]." 
While  the  Boeing  and  Northrop  models  can  be  manipulated 
in  the  same  manner,  the  user  should  be  aware  of  the 
difference  between  the  unit  cost  and  cumulative  unit 
cost  measured  by  these  respective  models.  The  unit 
learning  curve  will  be  the  model  used  for  the  rest  of 
this  paper  [6:7-9] , 
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Limitations  of  the  Standard  Learnin; 


Curve  Model 


Probably  due  to  its  simplicity,  intuitive  appeal,  and 
long  history,  the  learning  curve  model  is  still  widely 
used.  However,  the  learning  curve  model  does  not  take 
into  account  the  exogenous  changes  in  the  rate  of  pro¬ 
duction.  Those  exogenous  changes  are  a  concern  of  this 
research,  as  is  their  effect  upon  the  total  direct  labor 
requirements. 

Concern  about  exogenous  changes  in  production  rate  is 
justified  by  the  following  factors:  (1)  workers  will 
adjust  according  to  pressure  to  speed  up  or  slow  down 
production;  (2)  as  more  workers  are  employed,  the  dis¬ 
tribution  of  tasks  to  each  individual  worker  should 
narrow;  and  (3)  at  higher  production  rates,  tooling 
costs  can  be  more  widely  allocated  to  larger  numbers  of 
units  (21 :44)  . 

Fiscal  prudence  dictates  that  each  echelon  within 
DOD  strive  for  accurate  cost  prediction  in  order  to 
budget,  manage,  and  control.  It  naturally  follows  that 
the  importance  of  production  rates  in  cost  estimating 
must  be  investigated  fully,  and  that  DOD  buyers  must 
consider  the  effects  of  production  rate  changes  through¬ 
out  the  acquisition  process  [16:11]. 


History  of  Efforts  to  Add  Production 
Rate  Variable 


The  focus  of  this  research  involves  the  addition  of  the 
production  rate  as  a  second  independent  variable  in  the  learning 
curve  model.  This  section  will  present  a  chronological  history 
of  some  of  the  more  important  work  that  has  been  done  in  this 
regard.  The  list  is  not  exhaustive,  and  is  intended  only  to 
provide  the  reader  with  a  summary  of  the  most  widely  recog¬ 
nized  research  efforts  in  this  field.  Not  all  researchers 
have  agreed  about  the  usefulness  of  the  production  rate  vari¬ 
able.  However,  recent  efforts  show  great  promise  for  the  pro¬ 
duction  rate  to  aid  in  more  accurate  predictions  of  labor 
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requirements . 


Harold  Asher  Study 

Asher  examined  the  relationship  between  cost  and  quan¬ 
tity  in  the  airframe  industry.  Using  empirical  data  from 
several  airframe  production  programs,  he  subjectively  evalu¬ 
ated  the  effect  of  the  production  rate  on  direct  labor  hour 
requirements.  Asher  identified  two  ways  in  which  the  produc¬ 
tion  rate  could  affect  unit  labor  cost.  First,  it  can  affect 
the  amount  of  machine  set-up  time  charged  to  each  unit  of  pro¬ 
duction.  Second,  it  can  affect  the  number  of  subassemblies 
in  the  manufacturing  process  which,  in  turn,  affects  the 
number  of  hours  of  subassembly  work  charged  to  each  unit.  He 
concluded  that  production  rate  was  not  very  important  as  a 
predictor  when  compared  to  the  effect  of  cumulative  production 
(2:86-87) . 

Alchian  and  Allen  Research 

Alchian  and  Allen  advanced  the  idea  that  production 
cost  is  dependent  on  three  production  variables:  1)  total 
volume  of  the  item  to  be  produced,  2)  production  rate,  and  3) 
amount  of  time  from  the  decision  to  produce  until  the  first 
output  occurs  (15:19).  They  drew  three  major  conclusions. 
First,  larger  total  volumes  lead  to  smaller  unit  costs  because 
of  increased  product  standardization  that  accompanies  larger 
volume.  Second,  unit  costs  increase  with  increasing  produc¬ 
tion  rates  because  more  overtime  and  less  efficient  workers 
are  needed  to  support  the  increased  production  rate.  Third, 
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the  cost  variable  increases  if  the  initial  production  start¬ 
up  time  is  compressed.  They  explained  that  less  efficient 
procedures  are  used  than  if  time  were  allowed  to  prepare 
properly  for  production.  Subsequent  effort  must  be  expended 
to  correct  these  inefficiencies  and  results  in  higher  unit 
costs  (.1 :  308-322)  . 

Although  Alchian  and  Allen  did  not  test  their  conclu¬ 
sions  on  actual  data,  it  is  felt  that  their  ideas  may  have 
application  to  the  airframe  industry  (15:20). 


Gordon  J.  Johnson  Article 

Johnson  predicted  labor  requirements  for  rocket  motors 
using  an  additive  model  which  considered  both  the  rate  effect 
and  the  learning  effect.  The  model  he  used  was 

y  -  A  ♦  BX:  ♦  CX^ 


where : 


y  represents  direct  labor  hours  per  month, 

X.  represents  production  rate  in  equivalent  units  per 
month, 


X^  represents  cumulative  units  produced  as  of  the  end 
"  of  each  month,  and 


A,B,C,Z  are  model  parameters. 


Johnson  regressed  this  model  against  four  sets  of 
rocket  motor  data.  His  results  are  shown  in  Table  1. 
As  depicted  in  the  table,  Johnson  had  good  results 
(high  R2)  with  data  sets  1  and  4,  fair  results  with 
data  set  2,  and  poor  results  with  data  set  3.  Johnson 
explained  data  set  3's  poor  results  as  being  due  to  an 
inadequate  accounting  system  used  by  the  manufacturer. 
He  concluded  that  the  production  rate  is  a  significant 
determinant  of  direct  labor  requirements  [6:10]. 
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TABLE  1 


Summary  of  Johnson's  Regression  Analysis 


Regression  Variables 

Coefficients  of  * 
Determination  (R2) 

Data  Set 

Labor  Hours  vs  Cumulative  Units 

Labor  Hours  vs  Cumulative  Units 

8  Production  Rate 

.753  .395  .00678  .763 

.932  .808  .308  .927 

2 

*R  represents  the  proportion  of  the  variation  in  direct 
labor  hours  that  is  explained  by  the  regression  model. 

Source:  (8:34) 

Joseph  A.  Orsini  Thesis 

Orsini  (12:37-80)  tested  Johnson's  rocket  motor  model 
using  airframe  data  from  the  C-141  program.  He  employed  the 
following  procedure:  1)  regression  analysis  was  performed  on 
the  data  using  the  standard  unit  learning  curve  model,  2) 
regression  analysis  was  again  performed  using  Johnson’s  three 
dimensional  additive  model  that  incorporated  rate  of  produc¬ 
tion,  and  3)  analysis  was  performed  after  converting  Johnson's 
additive  model  into  a  multiplicative  one  which  is  stated  as 
follows : 


where 


X 


Y 

1 


Y 


2 


represents  the  direct  labor  hours  per  quarter, 
represents  the  number  of  units  produced  per  quarter, 
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X,  represents  the  cumulative  number  of  units  produced 
1  as  of  the  end  of  each  quarter, 

S0,81*82  are  mo<*el  parameters,  and 

e  is  the  base  of  natural  logarithms. 

Orsini  concluded  that  1)  inclusion  of  the  production  rate  as 
an  independent  variable  significantly  improved  the  predictive 
ability  of  both  the  additive  and  multiplicative  models  and  2) 
the  multiplicative  model  performed  better  as  a  predictor  than 
did  the  additive  one  because  it  eliminated  the  need  to  esti¬ 
mate  the  parameter  Z  (12:71). 


Large,  Hoffmayer,  and  Kontrovich 
Study 

During  an  effort  to  develop  a  general  cost  model  spon¬ 
sored  by  the  Office  of  the  Secretary  of  Defense,  these  three 
investigators  examined  data  from  major  airframe  acquisitions 
relating  to  the  effect  of  production  rate  on  cost.  The  model 
used,  according  to  Smith  (15:29-30),  is  of  the  form: 


Yi 


w 


B 


C  D 
s  •  r 


where : 


Yi  represents  the  cumulative  direct  manufacturing 
labor  hours  through  unit  number  i> 

w  represents  the  program  average  weight  in  pounds 
as  expressed  by  the  Defense  Contractor  Planning 
Report  (DCPR) , 

s  represents  the  maximum  design  airspeed  in  knots » 

r  represents  the  production  rate  expressed  as  the 
acceptance  span  in  months  for  the  first  i  air¬ 
frames  (for  their  investigation  Large,  Hoffmayer, 
and  Kontrovich  chose  i  arbitrarily  to  be  100  or  200) » 

A,B,C,D  are  model  parameters. 


Large,  Hoffmayer,  and  Kontrovich  concluded  that  the 
effects  of  the  production  rate  could  not  be  predicted  with 
confidence,  especially  in  the  early  stages  of  a  major  acqui¬ 
sition.  They  felt  that  each  case  must  be  considered  separately 
(9:50-51).  Smith  (15:31)  indicated  that  the  use  of  an  accept¬ 
ance  span  as  a  proxy  for  production  rate  masked  the  true 
effect  of  the  production  rate  because  of  the  resultant  averag¬ 
ing  effect. 


Joseph  Noah  Research 

Noah  analyzed  cost  data  to  find  the  effect  of  produc¬ 
tion  rate  on  airframe  costs.  His  model  for  the  data  was: 


y 


x 


D 

3 


where: 

y  represents  average  direct  labor  hours  per  pound 
of  airframe  for  each  airframe  lot, 

e  is  the  base  of  the  natural  logarithm, 

X.  represents  the  cumulative  volume  in  pounds  of 
aircraft  produced  by  the  midpoint  of  each  air¬ 
frame  lot, 

X2  represents  the  production  rate  in  average  pounds 

~  of  airframe  delivered  per  month  for  the  entire 
period, 

X3  represents  the  annual  volume  of  aircraft  in 
airframe  pounds ,  and 

A,B,C,D  are  model  parameters. 

Noah  averaged  the  estimated  regression  coefficients 
from  two  sets  of  data,  one  on  the  F-4  and  the  other  on 
the  A-7,  and  tried  to  develop  a  generalized  cost  model. 
Smith  felt  that  this  approach  was  questionable  and  that 
the  model  needed  to  be  tested  on  additional  aircraft 
programs  to  determine  if  it  did  actually  serve  as  an 
accurate  predictor.  Also,  Smith  stated  that  while  the 
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lot  average  airframe  delivery  rate  was  a  practical 
representation  of  the  production  rate,  the  average 
delivery  rate  variable  appears  to  lag  the  average 
expenditure  of  hours  required  to  produce  the  air¬ 
frames  delivered  [6:10,  12]. 


Larry  L.  Smith  Dissertation 

Smith  developed  a  model  for  airframe  production  that 
included  a  production  rate  variable  to  test  the  idea  that 
production  rate  changes  can  explain  changes  in  direct  labor 
requirements  (15:35).  He  adapted  a  modified  version  of  Orsini's 
multiplicative  model  as  follows: 


Y. 


l 


10 


e . 
i 


where : 


Y.  represents  the  unit  average  direct  labor  hours 

needed  to  output  each  pound  of  airframe  in  lot  i, 

Xi-  represents  the  cumulative  learning  accrued  from 
experience  on  all  airframes  of  the  same  type 
through  lot  i, 

X_.  represents  the  production  rate  of  lot  i  for  all 
airframes  of  the  same  type, 

e-  represents  the  variation  of  each  dependent 
variable  which  is  not  explained  by  the  two 
independent  variables, 


SO,Sl,02  are  Parameters  in  the  model  (15:43). 


Smith  also  linearized  the  model  to  facilitate  multiple  linear 
regression.  The  linearized  form  was  (15:45): 


Log  Y i  -  Log  3q  ♦  8X  Log  Xu  ♦  &2  Log  X2i  ♦  ei 


Smith  used  two  proxies  for  the  production  rate  variable. 
The  "lot  average  manufacturing  rate"  included  the  number  of 
airframes  in  a  lot  divided  by  the  lot  time  span,  where  lot  time 


14 


span  was  the  time  between  release  date  from  the  lot  for  the 
first  airframe  in  the  lot.  The  "lot  delivery  rate"  was  the 
actual  monthly  airframe  acceptance  rate  (15:11-13). 

To  test  the  accuracy  of  his  model  versus  the  standard 
learning  curve  model.  Smith  employed  a  "reduced"  model  which 
was  merely  his  model,  or  "full"  model,  minus  the  production 
rate  variable.  The  "reduced"  model  was  a  unit  learning  curve 
model  as  follows  (13:43): 


Xli 


81 


10 


ei 


Regression  of  historical  data  with  each  model  allowed  Smith  to 
identify  the  contribution  of  predictive  ability  by  the  produc¬ 
tion  rate  variable  (16:17-18). 

Evaluating  data  from  the  F-4,  F-102,  and  KC-135  airframe 
production  programs,  Smith  reached  the  following  conclusions: 

1)  in  each  case,  the  production  rate  variable  was  negatively 
correlated  with  unit  direct  labor  requirements,  2)  both  proxies 
to  the  production  rate  variable  were  important  contributors  to 
the  full  model's  predictive  ability,  and  3)  as  evidenced  by 
the  R  values  he  obtained,  the  full  model  more  closely  fit  the 
data  than  the  reduced  model  (15:142-146).  Tables  2  and  3 
summarize  Smith's  regression  analysis  and  predictive  ability 
test  results. 


Congleton  and  Kinton  Thesis 

Using  the  same  methodology,  Congleton  and  Kinton  repli¬ 
cated  Smith's  research  for  the  T-38  and  F-5  airframe  production 
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••Smith's  methodology,  production  rate  proxies,  and  Rz  versus  Rz  (actual)  are 
all  recapped  in  Chapters  II  and  III  of  this  research.  The  subscripts  for  r2 
are  as  follows:  f  stands  for  full  model;  r  for  the  reduced. 

•••Impractical  for  test  situations. 


TABLE  3 


Summary  of  Smith's  Predictive  Ability 
Test  Results 


Test 

Situation 

No. 

Percentage 

Deviation* 

£ull  Model 

Reduced  Model 

1 

-2.6 

14.5 

2 

2.2 

13.6 

3 

Not  Reported 

13.6 

4 

1.8 

5.3 

5 

3.1 

5.3 

6 

-7.8 

Not  Reported 

7 

** 

Not  Reported 

8 

-0.7 

1.1 

9 

-4.2 

1.1 

10 

-1.1 

5.6 

11 

3.5 

Not  Reported 

12 

2.2 

-3.3 

13-16 

*** 

*** 

*These  tests  were  conducted  as  described  in  Chapter  IV  of 
this  research  (15:56).  All  percentages  are  rounded  to 
nearest  tenth. 

**Smith  reported  the  results  were  deviations  greater  than 
than  those  for  test  situation  6,  but  did  not  report  a 
value  (15:96). 

***Smith  reported  that  predictive  ability  tests  were  im¬ 
practical  for  situations  13  through  16  because  observa¬ 
tions  were  limited  to  seven  (15:71-131). 
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programs.  They  reached  the  same  basic  conclusions  as  Smith; 
however,  in  one  of  the  thirty  test  situations  they  reported 
that  R^  was  higher  for  the  reduced  model  than  for  the  full 
model,  but  by  less  than  one  percent  (5:91-93). 

Stevens  and  Thomerson  Thesis 

Stevens  and  Thomerson  replicated  Smith's  model  for  air¬ 
craft  avionics  systems.  Specifically,  they  examined  the 
Magnavox  ARC- 164  radio  and  the  Teledyne  Computer  Signal  Data 
Converter.  AfteT  applying  the  methodology  set  forth  by  Smith, 
Stevens  and  Thomerson  formed  the  following  conclusions:  1) 
production  rate  was  a  significant  explainer  of  variation  in 
direct  labor  hours  in  nine  of  ten  cases,  2)  the  predictive 
ability  of  the  full  model  was  better  than  that  of  the  reduced 
model  for  18  months  into  the  future,  3)  the  standard  learning 
curve  (reduced)  model  consistently  overestimated  direct  labor 
hours  while  the  full  model  stabilized  predictions  over  an 
extended  interval,  4)  regression  coefficients  are  unique  to 
the  program  for  which  they  are  derived,  and  5)  the  overall 
applicability  of  Smith's  model  has  wide  potential  and  can  be 
tailored  to  various  other  programs  (16:102-104). 

Crozier  and  McGann  Thesis 

Crozier  and  McGann  also  replicated  Smith's  research. 

They  applied  both  the  reduced  model  (standard  learning  curve) 
and  the  full  model  to  three  aircraft  engine  programs:  1) 
the  General  Electric  J-79,  2)  the  Allison  TF-41,  and  3)  the 
Pratt  and  Whitney  F-100.  They  found  that  the  production  rate 
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significantly  explained  variation  in  direct  labor  hours  in 
three  of  six  cases  examined,  with  especially  good  results  on 
the  F-100  engine.  On  all  engine  programs,  the  full  model 
was  a  better  predictor  than  the  reduced  model.  Crozier  and 
McGann  concluded  that  the  results  when  using  Smith's  model 
depend  a  great  deal  on  the  type  of  weapon  system.  This  last 
finding  justifies  the  need  for  more  replication  efforts  of 
Smith's  model  (6:92-94). 


Summary 

The  dominant  theme  of  the  literature  review  has  been 
the  relationship  between  production  rate  and  direct  labor 
hour  requirements.  While  not  all  researchers  have  agreed, 
there  is  significant  evidence  that  production  rate  is  aa 
important  contributor  to  the  predictive  ability  of  learning 
curves.  This  research  will  examine  that  relationship  for 
selected  missile  production  programs.  Chapter  III  will  out¬ 
line  the  methodology  used  in  this  research  effort. 
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CHAPTER  III 


RESEARCH  METHODOLOGY 

This  chapter  outlines  the  research  hypotheses  and  the 
methodology  used  to  test  them.  The  chapter  is  divided  into 
six  sections  as  follows: 

1)  Objectives  and  Approach, 

2)  Model  Variables, 

3)  Model  Definitions  and  Assumptions, 

4)  Research  Hypotheses, 

5)  Data  Collection  and  Treatment, 

6)  Summary. 


Objectives  and  Approach 

The  objectives  of  this  research  were:  1)  to  determine 
if  the  direct  labor  requirements  for  missile  production  were 
affected  by  the  production  rate,  and  2)  to  determine  if  the 
production  rate  model  was  a  better  predictor  of  labor  require¬ 
ments  than  the  basic  learning  curve  model.  Meeting  these 
objectives  also  established  the  applicability  of  Smith's  pro¬ 
duction  rate  model  to  missile  production. 

The  approach  was  to  collect  historical  production  data 
from  two  missile  programs,  the  Maverick  manufactured  by  the 
Hughes  Corporation,  and  the  Short  Range  Attack  Missile  (SRAM) 
manufactured  by  the  Boeing  Company.  These  data  were  then 
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evaluated  using  Smith's  production  rate  model.  As  in  all 
previous  research  using  Smith's  production  rate  model,  the 
model  was  adjusted  to  specific  data  groups.  No  attempt  was 
made  to  develop  a  generalized  labor  hour  model  to  be  used  in 
all  types  of  missile  production. 

Model  Variables 

The  three  variables  evaluated  in  this  analysis  were: 

1)  direct  labor  hours, 

2)  cumulative  output, 

3)  production  rate. 

Since  it  was  desirable  to  improve  the  ability  to  predict  dir¬ 
ect  labor  hour  requirements,  this  variable  was  designated  as 
the  dependent  variable.  Cumulative  output  and  the  production 
rate  were  treated  as  independent  variables. 

The  Direct  Labor  Hours  Variable 

Direct  labor  is  usually  measured  in  hours,  although  it 
is  occasionally  measured  in  dollars.  Whenever  the  data  are 
expressed  in  dollars,  care  must  be  taken  to  accurately  account 
for  inflation.  The  primary  determinants  of  total  direct  labor 
are:  fabrication  labor,  assembly  labor,  and  test  labor.  De¬ 
pending  on  the  individual  contractor,  the  data  may  be  expressed 
as  total  labor  or  any  combination  of  the  component  parts  (fab¬ 
rication,  assembly,  and  test).  The  exact  form  of  the  data  is 
unimportant  as  long  as  a  consistent  unit  of  measurement  is 
maintained. 
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The  Cumulative  Output  Variable 

Records  are  normally  kept  for  the  number  of  missiles 
completed  each  month.  The  cumulative  output  is  the  total 
number  of  missiles  completed  since  the  beginning  of  the  pro¬ 
duction  program  as  of  the  end  of  a  specific  accounting  month. 

The  Production  Rate  Variable 

The  production  rate  is  simply  the  number  of  missiles 
completed  during  an  accounting  month.  For  some  production 
processes,  the  production  rate  is  difficult  to  accurately 
assess.  Whenever  this  situation  occurs,  a  proxy  must  be 
developed  for  the  production  rate.  Commonly  used  proxies  are 
the  delivery  rate  and  the  acceptance  rate.  A  caution  is  in 
order  whenever  proxies  are  used.  For  example,  the  delivery 
rate  (e.g.  as  reflected  on  DD  Form  250  acceptance  document) 
to  an  operational  wing  may  bear  little  or  no  resemblance  to 
the  actual  production  rate  at  the  plant.  Actual  production 
rates  are  preferrable  if  the  data  are  available.  If  proxies 
must  be  used,  they  should  be  chosen  with  care  so  as  not  to 
entirely  mask  the  effect  of  production  rate  variations. 

Model  Definitions  and  Assumptions 

Chapter  II  discussed  the  two  models  used  by  Smith,  which 
he  called  the  "full  model"  and  the  "reduced  model".  For  ease 
of  reference,  the  models  are  repeated  here. 

Model  Definitions 

The  reduced  model  is  the  basic  learning  curve  where: 
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Y. 
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In  the  full  model  the  production  rate  variable  is  added  as 
follows : 


Y. 


1 


10  1 


The  terms  used  in  these  models  are  defined  as  follows: 
represents  direct  labor  hours, 
represents  cumulative  output, 
represents  the  production  rate. 


Y. 

l 


kli 


k2i 


e . 

l 


S0  ’S1,S2 


represents  the  variation  which  is  left  unexplained 
by  the  variables  in  the  model,  and 

are  regression  coefficients. 


To  facilitate  multiple  linear  regression  of  the  two 
models,  they  were  transformed  to  a  linear  form  by  taking  the 
logarithm  of  each  term.  The  logarithmic  form  of  the  reduced 
model  is: 


Log  Y i  »  Log  eQ  +  Sx  Log  Xu  +  ej[ 

and  the  logarithmic  form  of  the  full  model  is : 

Log  -  Log  SQ  ♦  Sx  Log  Xu  +  &2  Log  X2i  +  ei 


Assumptions 

The  statistical  significance  of  the  results  of  the  re¬ 
gression  was  tested  using  appropriate  F-distribution  statis¬ 
tics.  To  establish  the  validity  of  these  tests,  it  was 
necessary  to  make  some  assumptions  concerning  the  error  terms 
in  the  model.  First,  the  error  terms  were  assumed  to  be 
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normally  distributed  with  a  mean  of  zero  and  constant  vari¬ 
ance.  Second,  the  error  terms  were  assumed  to  be  independent 
of  each  other  and  of  the  independent  variables  (10:30-31). 

The  first  two  assumptions  were  tested  using  the  procedures 
described  in  Criterion  Test  One  (A) . 

A  third  assumption  concerns  a  problem  which  frequently 
develops  in  multiple  linear  regression,  that  of  multicollin- 
earity.  Multicollinearity  exists  when  there  is  a  high  corre¬ 
lation  between  or  among  independent  variables,  which  in  this 
research  were  cumulative  output  and  production  rate.  If  a 
strong  correlation  exists  between  or  among  independent  vari¬ 
ables,  the  F-test  may  find  the  marginal  contribution  of  one 
or  more  variables  to  be  statistically  insignificant  when,  in 
fact,  they  may  be  good  explainers  of  variation  in  the  depend¬ 
ent  variable  if  considered  separately  (10:541). 

While  multicollinearity  can  be  a  serious  problem  if 
the  model  is  to  be  used  for  control,  it  is  not  as  serious  a 
problem  when  the  purpose  of  the  model  is  to  predict  as  was 
the  case  in  this  research  (10:342).  The  contribution  made 
by  adding  the  production  rate  to  the  reduced  model  was  sub¬ 
jectively  evaluated  by  comparing  predictions  of  the  reduced 
model  to  those  of  the  full  model.  Therefore,  it  was  assumed 
the  varying  degrees  of  multicollinearity  had  no  substantial 
impact  on  the  short-range  predictive  abilities  of  the  model. 

Research  Hypotheses 

Two  hypotheses  were  tested.  The  first  hypothesis  was 
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that  the  production  rate  explained  a  significant  amount  of 
the  variation  in  direct  labor  requirements  for  missile  pro¬ 
duction.  The  second  hypothesis  was  that  the  production  rate 
(full)  model  predicted  direct  labor  requirements  for  missile 
production  better  than  the  reduced  model  did. 

Research  Hypothesis  One 

The  first  research  hypothesis  was  tested  in  two  steps. 
The  first  step  examined  the  statistical  significance  of  the 
model's  regression  coefficients  by  regression  analysis  of 
historical  missile  production  data.  The  second  step  involved 
the  use  of  two  criterion  tests  to  evaluate  the  appropriate¬ 
ness  of  the  model  for  the  data."  The  dependent  variable  of 
the  full  model,  in  log- linear  form,  was  subjected  to  regres¬ 
sion  analysis.  The  independent  variables  were  the  logarithms 
of  cumulative  output  and  the  production  rate. 

Statistical  Hypothesis  One  CA~) 

Statistical  Hypothesis  One  (A)  stated  that  the  cumula¬ 
tive  output  variable  and  the  production  rate  variable  were 
related  to  labor  hours  as  shown  in  the  model.  The  null  hypo¬ 
thesis  and  its  alternative  were  formed  as  follows: 

Hg  :  3j_  and  02  ■  0 

H^:  01  f  0  and/or  S2  t  0 

The  decision  rule  was  as  follows:  the  null  hypothesis 
was  rejected  if  the  test  statistic  (F-ratio)  was  greater  than 
the  critical  statistic  (F-critical)  at  the  0.05  level  of 
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significance.  F-critical  values  were  extracted  from  Neter 
and  Vasserman' s  F-distribution  tables  (10:807-813). 
Mathematically, 

F-ratio  -  MSR/MSE 
MSR  -  SSR/(p-l) 

MSE  -  SSE/ (n-p) 

where: 

MSR  represents  the  mean  of  the  regression  sum  of 
squares  in  logarithmic  form, 

MSE  represents  the  mean  of  the  error  (or  residual) 
s\im  of  squares  in  logarithmic  form, 

SSR  represents  the  regression  sum  of  squares  in 
logarithmic  form, 

SSE  represents  the  error  (or  residual)  sum  of 
squares  in  logarithmic  form, 

n  represents  the  number  of  observations,  and 

p  represents  the  number  of  parameters  in  the  model 
(10  : 45 ,  79  ,  227-228)  . 

The  F-ratio  compared  the  explained  variance  (MSR)  to  the  unex¬ 
plained  variance  (MSE) ,  and  thus  determined  the  ability  of 
the  model  to  explain  the  variance  of  the  dependent  variable. 

Statistical  Hypothesis  One  (B) 

The  hypothesis  tested  the  ability  of  the  production 
rate  variable,  when  combined  with  the  cumulative  output  vari¬ 
able,  to  explain  additional  variation  in  direct  labor  hours 
per  missile.  Statistically,  the  null  and  alternate  hypotheses 


V 

S2 

»  0 

Hl: 

S2 

t  0 

were : 


As  before,  the  null  hypothesis  was  rejected  if  the  test 
statistic  F*  was  greater  than  the  critical  statistic  Fc  at 
the  0.05  level  of  significance.  The  value  of  F*  was  deter¬ 
mined  as  follows: 


F* 


_ _ 

(1-RZ) / (n-k-1) 


where : 

2 

AR  represents  the  increase  in  explained  variation 
caused  by  the  addition  of  the  logarithm  of  the 
production  rate  variable  to  the  reduced  model, 

2 

R  represents  the  amount  of  variation  in  direct 
labor  hours  explained  by  the  logarithmic  form 
of  the  full  model, 

g  represents  the  number  of  variables  (in  this 
case,  one)  which  cause  the  increase  in  Rs 

n  represents  the  number  of  observations, 

k  represents  the  total  number  of  regressors,  and 

n-k-1  represents  the  degrees  of  freedom  in  the 
unexplained  variation  (18:435). 

The  F*  statistic  in  this  test  yielded  a  ratio  of  the  increase 

in  explained  variance  to  the  remaining  unexplained  variance 

which  resulted  from  introducing  the  production  rate  variable 

into  the  reduced  model. 

However,  Neter  and  Wasserman  (10:253)  indicate  that  the 
increase  in  explained  variance  caused  by  introducing  the  pro¬ 
duction  rate  variable  must  be  qualified  if  correlation 
(multicollinearity)  exists  between  the  independent  variables. 
Whenever  correlation  exists,  the  increase  in  explained  vari¬ 
ance  is  not  solely  the  result  of  adding  the  new  independent 
variable.  So,  when  the  production  rate  variable  is  added  to 
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the  model,  the  magnitude  of  the  change  in  explained  variance 
is  partially  caused  by  the  already  present  effect  of  the 
cumulative  output  variable. 

When  independent  variables  are  correlated,  there  is 
no  unique  sum  of  squares  which  can  be  ascribed  to  an 
independent  variable  as  reflecting  its  effect  in  re¬ 
ducing  the  total  variation  in  Y.  The  reduction  in 
the  total  variation  ascribed  to  an  independent  vari¬ 
able  must  be  viewed  in  the  context  of  other  independ¬ 
ent  variables  included  in  the  model  whenever  the 
independent  variables  are  correlated  [10:253]. 

Criterion  Test  One  (A] 

The  first  criterion  test  for  the  appropriateness  of  the 
model  concerned  the  assumptions  about  the  residuals,  or  ob¬ 
served  errors.  The  model  was  considered  appropriate  for  the 
data  if  assumptions  about  constant  variance  of  residuals, 
independence  of  residuals,  and  normal  distribution  of  resi¬ 
duals  could  not  be  rejected  on  the  basis  of  appropriate  tests 
(10:240)  . 

The  assumption  of  constant  variance  of  residuals  was 
tested  by  plotting  the  residual  values  against  the  predicted 
values  of  the  dependent  variable.  The  assumption  was  accepted 
if  the  plot  revealed  an  even  distribution  (no  discernible 
pattern)  and  if  most  residuals  were  within  one  standard  error 
of  the  estimate  (10:239-240). 

The  Durbin-Watson  Test  (11:358-361,  816)  was  used  to 
check  for  independence  of  residuals.  The  test  determined 
whether  or  not  the  autocorrelation  parameter  P  was  equal  to 
zero.  The  test  alternatives  were: 
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Hq :  p  >  0 

Hx:  P  -  0 

A  statistical  package  called  "STAT  II"  in  the  Copper  Impact 
Library  at  the  Air  Force  Institute  of  Technology  calculated 
the  Durbin-Watson  statistic  designated  as  D.  Table  A-6  in 
the  Neter  and  Vasserman  text  contained  upper  and  lower  bounds 
(du  and  d^)  for  various  sample  sizes,  levels  of  significance, 
and  numbers  of  independent  variables.  The  calculated  sta¬ 
tistic  D  was  compared  to  the  upper  and  lower  bounds  in  the 
table  at  the  .05  level  of  significance.  The  decision  rule 
was  as  follows: 

If  D  <  dQ,  conclude  Hq 

If  D  >  d^,  conclude 

If  d^  <_  D  du,  the  test  is  inconclusive. 

If  alternative  Hj^  was  concluded,  the  residuals  were  considered 
to  be  independent. 

The  assumption  of  normal  distribution  of  residuals  was 
tested  in  two  ways.  The  first,  and  more  stringent,  test  was 
the  Kolmogorov -Smirnov  (K-S)  test.  If  the  K-S  test  indicated 
a  problem,  then  the  residuals  were  plotted  on  normal  proba¬ 
bility  paper  to  see  if  the  plot  approximated  a  straight  line 
(11:107-108,  112). 

The  basis  of  the  K-S  estimation  procedure  is  the  cumu¬ 
lative  sample  function,  which  is  denoted  by  S(X).  S(X) 
specifies  for  each  value  of  X  the  proportion  of  values  less 
than  or  equal  to  X,  i.e.  S(X)  is  simply  a  step- function 
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ogive  (11:403).  The  K-S  procedure  utilizes  a  statistic, 
denoted  by  D(n) ,  which  is  based  on  the  differences  between 
the  cumulative  sample  function  S(X)  and  the  true  cumulative 
probability  function  F(X). 

D(n)  -  Max jS(X)  -  F(X)j 

In  other  words,  D(n)  equals  the  largest  absolute  deviation 
of  S(X)  from  F(X)  at  any  value  of  X.  D(n)  is  shown  as  a 
function  of  n  because  it  depends  on  the  sample  size.  Sur¬ 
prisingly,  however,  it  does  not  depend  on  the  specific  form 
of  F(X).  Hence  the  K-S  procedure  may  be  used  for  goodness 
of  fit  tests  for  any  shape  distribution,  and  was  used  in  this 
case  to  see  if  the  residuals  were  normally  distributed  (H: 
403-404)  . 

The  K-S  statistic  used  in  this  research  was  calculated 
by  the  STAT  II  package  in  the  Copper  Impact  Library.  If  the 
calculated  statistic  was  below  the  critical  value  in  the 
D(n)  table  (10:709),  the  data  were  considered  normal.  Stated 
in  hypothesis  form: 

Hq:  K-S*>D(n)c 

H1:  K-S*  <  D(n)c 


Criterion  Test  One  (B) 

The  second  test  of  the  appropriateness  of  the  model 
involved  the  use  of  the  multiple  coefficient  of  determina- 
tion,  known  as  R^.  The  value  measured  the  proportion  of 
variation  in  direct  labor  hours  that  was  explained  by  the 
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regression  model.  R  was  calculated  by  subtracting  the  quo¬ 
tient  of  SSE/SSTO  from  one.  The  error  sum  of  squares,  SSE, 
was  the  summation  of  all  squared  residuals,  and  was  formally 
defined  in  statistical  hypothesis  one  (A) .  The  total  sum  of 
squares,  SSTO,  was  calculated  by  summing  the  squared  differ¬ 
ences  between  each  observed  value  and  the  mean  of  the  depend¬ 
ent  variable  (10277). 

2 

In  this  model,  R  as  a  valid  measure  of  explained  vari¬ 
ation  was  somewhat  obscured  by  the  transformation  of  the  model 
to  the  logarithmic  form.  R  in  that  form  represented  the 
logarithmic  value  of  direct  labor  hour  variation  rather  than 

variation  in  actual  hours.  Smith,  in  his  research,  developed 

2 

a  more  meaningful  statistic  which  he  called  R  (actual)  (IS: 

2  2 
S3).  R  (actual)  was  calculated  in  the  same  way  that  R  was, 

except  that  the  SSE  and  SSTO  values  were  calculated  after 
transforming  the  observed  and  predicted  values  of  the  depend¬ 
ent  variable  from  logarithmic  to  actual  form.  In  that  way, 
the  variation  was  represented  in  actual  hours  instead  of 
logarithms . 

An  appropriate  model  for  the  data  would  explain  a  high 
proportion  of  variation  in  direct  labor,  and  would  consequent¬ 
ly  yield  a  high  R^  (actual).  Therefore,  in  this  criterion 
test,  an  R^  (actual)  value  of  .75  or  higher  was  selected  as 
the  level  at  which  the  model  could  not  be  rejected  as  inappro¬ 
priate. 

If  the  model  was  not  rejected  by  either  of  the  statisti¬ 
cal  tests  or  criterion  tests,  its  predictive  ability  was  then 
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tested  under  research  hypothesis  two. 


Research  Hypothesis  Two 

As  stressed  in  Chapter  I,  a  primary  objective  of  this 
research  was  to  determine  which  form  of  the  learning  curve 
would  best  predict  direct  labor  hour  requirements  in  a  con¬ 
tinuing  missile  production  program.  After  the  full  model 
was  successfully  developed  under  research  hypothesis  one, 
its  predictive  ability  was  compared  to  that  of  the  reduced 
model.  Research  Hypothesis  Two  stated  that  the  full  model 
would  be  a  better  predictor  than  the  reduced  model. 

Smith's  production  rate  model  simulated  future  predic¬ 
tive  ability  by  performing  a  stepwise  truncation  of  the 
historical  data.  Smith  described  the  process  as  follows: 

In  a  real  application  of  the  model,  the  prediction 
would  be  beyond  the  range  of  the  historical  data. 

The  only  way  to  test  the  accuracy  of  the  prediction 
would  be  to  wait  and  see  how  many  hours  it  takes  to 
build  the  next  airframe  lot.  To  simulate  this  situa¬ 
tion,  the  regression  coefficients  in  the  model  are 
estimated  with  the  last  few  observed  data  points 
omitted.  Then  using  the  new  model,  omitted  values 
(which  are  known  but  not  used  in  estimating  the  model 
coefficients)  are  predicted.  Comparisons  are  then 
drawn  between  the  actual  and  predicted  hours  as  a 
subjective  measure  of  predictive  ability  115:56]. 

In  this  research,  12  data  points  were  omitted  and  then 
predicted.  Twelve  data  points  were  chosen  to  simulate  the 
typical  "real  world"  application  of  learning  curve  models 
to  estimate  costs  for  the  next  fiscal  year  (12  months)  of 
production. 

The  second  research  hypothesis  was  evaluated  using  both 
a  statistical  hypothesis  and  a  criterion  test.  The  statistical 
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hypothesis  was  used  to  determine  whether  the  full  model  was 
significantly  better  than  the  reduced  model  in  predicting 
the  labor  hour  values  omitted  in  the  prediction  simulation. 
Where  the  full  model  was  found  to  be  a  significantly  better 
predictor  based  on  the  statistical  test,  a  criterion  test 
was  then  applied  to  established  whether  the  improved  predic¬ 
tive  ability  of  the  full  model  had  a  practical  significance 
as  well. 

Statistical  Hypothesis  Two 

A  statistical  test  was  performed  to  determine  if  the 
average  absolute  deviation  of  the  full  model  (|Bp|)  was  sig¬ 
nificantly  less  than  that  of  the  reduced  model  The 

average  absolute  deviation  foT  each  model  was  computed  by 
taking  the  absolute  value  of  the  difference  between  the  actual 
and  predicted  direct  labor  hours  occurring  in  each  test  situa¬ 
tion,  then  separately  summing  the  absolute  deviations  for 
each  model  in  all  test  situations.  Statistically,  the  null 
and  alternate  hypotheses  were: 

V  "V  i  'V 

HJ:  |DR|  >  | Dp | 

The  hypothesis  was  tested  using  the  Student's  t  distri¬ 
bution  (less  than  60  test  situations)  and  the  Z  statistic  (more 
than  60  test  situations) .  The  assumptions  of  normal  distribu¬ 
tion  and  randomness  of  the  deviations,  examined  in  research 
hypothesis  one,  remained  in  effect  during  this  test.  The 
decision  rule  using  the  Student's  t  statistic  was  as  follows: 
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where: 


Reject  H0  if  t  >  tc(.05) 

t  -  (|IJR|  -  |nF|)//(s|/N)  *  (Sp/N) 

and 

2 

SR  represents  the  variance  of  the  distribution  of 
deviations  obtained  with  the  reduced  model, 

Sp  represents  the  variance  of  the  distribution  of 
deviations  obtained  with  the  full  model, 

N  represents  the  number  of  test  situations, 

t  represents  the  critical  t  value  obtained  from 

a  table  of  Student's  t  critical  values  (18:208-215). 

Criterion  Test  Two 

Where  the  improved  predictive  ability  of  the  full  model 
over  the  reduced  model  was  shown  to  be  statistically  signi¬ 
ficant,  the  model  was  then  subjected  to  a  test  of  practical 
significance.  This  test  was  necessary  because  1)  the  re¬ 
duced  model,  although  shown  to  be  a  statistically  less 
accurate  predictor,  could  still  be  sufficiently  accurate  for 
practical  application,  or  2)  the  full  model,  although  shown 
to  be  a  statistically  better  predictor  than  the  reduced  model, 
could  still  be  so  inaccurate  as  to  be  of  no  value  in  practi¬ 
cal  application.  In  either  instance,  the  addition  of  the 
production  rate  variable  would  not  be  considered  worthwhile 
from  a  cost/benefit  standpoint. 

To  perform  the  criterion  test,  the  individual  deviations 
computed  for  the  full  and  reduced  models  in  each  test  situation 
under  statistical  hypothesis  two  were  converted  into  a  measure 
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of  deviation  expressed  as  a  percentage  of  the  actual  direct 
labor  hours.  The  use  of  percentages  facilitated  comparison 
of  results  between  programs  whose  values  for  direct  labor 
hours  were  relatively  small  and  programs  whose  values  for 
direct  labor  hours  were  relatively  large.  Two  categories 
were  then  established  for  the  deviations. 

These  categories  provided  a  basis  for  comparison  of 
the  predictive  ability  of  the  two  models.  When  percentage 
deviations  fell  in  the  range  from  greater  than  five  percent 
to  ten  percent,  the  predictive  ability  was  categorized  as 
good.  When  percentage  deviations  were  five  percent  or  less, 
the  predictive  ability  was  categorized  as  excellent.  The 
number  of  test  situations  in  which  the  percentage  deviations 
fell  into  each  category  was  then  separately  summed  for  the 
full  and  reduced  models.  Totals  for  each  category  and  model 
were  then  subjectively  compared  and  the  model  with  the 
greater  total  number  of  good  and  excellent  predictions  was 
judged  to  have  the  better  practical  predictive  ability. 

Data  Collection  and  Treatment 

Historical  data  from  two  separate  missile  production 
programs,  SRAM  and  Maverick,  were  collected.  Because  of 
differences  in  programs,  data  collection  and  treatment  of  the 
model  variables  are  discussed  separately  for  each  program. 
Pertinent  background  information  and  treatment  of  the  vari¬ 
ables  will  be  discussed  first  for  SRAM  and  then  for  Maverick. 
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The  SRAM  Program 

The  AGM-69,  better  known  as  SRAM,  was  produced  by  the 
Boeing  Aerospace  Company  in  three  production  runs  (A,  B,  and 
C)  for  use  on  the  B-52,  FB-111,  and  was  projected  for  use  on 
the  B-l.  Production  of  this  air-launched  missile  occurred 
from  February  of  1972  through  August  of  1975,  a  period  of 
42  months. 

There  were  three  elements  of  production  direct  labor 
hours  for  the  SRAM  program:'*'  fabrication,  minor  assembly, 
and  major  assembly.  Fabrication  was  defined  as  shop  effort 
expended  in  the  manufacture  of  individual  detail  parts  in 
economic  lot  sizes.  This  effort  included  such  activities  as 
shearing,  shaping,  drilling,  and  machining.  Minor  assembly 
was  defined  as  shop  effort  expended  in  joining  of  detail  parts 
by  methods  such  as  welding,  riveting,  soldering,  and  bolting. 
Minor  assembly  was  normally  conducted  in  economic  lot  sizes. 
Major  assembly  was  defined  as  shop  effort  expended  in  joining 
sub-assemblies  into  a  final  product  and  included  a  functional 
test  of  the  end  product.  Major  assembly  was  conducted  on  a 
unit  by  unit  basis. 

At  the  one  hundredth  unit  of  production,  an  accounting 
change  caused  an  aberration  in  the  labor  hours  for  fabrication 
and  minor  assembly.  Adding  the  fabrication  hours  and  minor 
assembly  hours  resolved  this  problem.  Therefore,  for  the 


^This  information  was  obtained  during  a  visit  to  the 
manufacturer's  plant  in  Seattle,  Washington  in  December  1979. 


purpose  of  this  research,  fabrication  and  minor  assembly  were 
considered  together  as  one  category. 

The  SRAM  data  were  collected  from  two  sources.  The 
Boeing  Company  provided  data  for  the  dependent  variable, 
actual  direct  labor  hours  per  missile.  The  Boeing  data  also 
contained  delivery  rates  to  operational  wings  as  recorded  on 
DD  Forms  2S0.  As  indicated  before,  delivery  rate  can  be  used 
as  a  proxy  for  the  production  rate.  The  Strategic  Systems 
Program  Office  (Strategic  SPO)  at  Wright-Patterson  AFB  provided 
data  for  the  independent  variables,  cumulative  output  and  pro¬ 
duction  rate.  This  data  contained  the  actual  production  rate 
per  accounting  month.  Accounting  months  were  derived  using 
a  perpetual  calendar  to  identify  the  number  of  working  days 
per  calendar  month.  A  problem  was  encountered  with  this  data 
in  that  some  of  the  information  was  missing.  Of  the  42  possible 
data  points,  only  22  were  available,  thereby  creating  an  un¬ 
intended  sample  of  the  overall  population.  The  possibility 
of  sampling  error  decreased  the  confidence  in  the  analysis 
results.  However,  the  sample  was  large  enough  to  generalize 
the  results  to  the  population.  An  exact  sampling  error  could 
not  be  computed  because  the  sample  was  not  randomly  chosen. 

Four  models  were  derived  from  the  SRAM  data  based  on 
various  treatments  of  the  variables.  The  four  models  and 
treatment  of  the  variables  within  each  model  are  discussed 
below. 

Model  1.  The  dependent  variable  for  Model  1  was  desig¬ 
nated  Y ^  and  represented  the  fabrication/minor  assembly 
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component  of  total  direct  labor  hours.  The  independent  vari¬ 
ables  were  treated  the  same  for  Models  1  through  3  and  are 
discussed  here,  but  not  repeated  in  the  discussion  of  Models 
2  and  3.  The  production  rate  used  was  designated  X£  and  was 
the  actual  production  rate  obtained  from  the  Strategic  SPO. 
Summing  each  month's  actual  production  rate  resulted  in  the 
cumulative  output  variable  which  was  designated  . 

Model  2.  The  dependent  variable  for  Model  2  was  desig¬ 
nated  as  Y  and  represented  the  major  assembly  portion  of 
total  direct  labor  hours  per  unit. 

Model  5.  The  dependent  variable  for  Model  3  was  desig¬ 
nated  Y  and  represented  the  sum  of  total  direct  labor  hours 
per  unit. 

Model  4.  The  dependent  variable  for  Model  4  was  desig¬ 
nated  Yt  and  represented  total  direct  labor  hours  per  unit. 
However,  differing  from  Models  1  through  3,  the  delivery  rate 
(DD250)  was  used  as  a  proxy  for  the  actual  production  rate. 
Model  4  was  used  for  two  reasons:  1)  to  assess  the  perform¬ 
ance  of  the  delivery  rate  as  a  proxy  for  the  actual  production 
rate,  and  2)  the  use  of  the  delivery  rate  proxy  allowed  the 
utilization  of  all  42  data  points  (months)  and  provided  a 
point  of  reference  to  ascertain  the  severity  of  the  sampling 
error  in  Models  1  through  3.  The  delivery  rate  data  were 
recorded  by  calendar  month.  Once  again,  summing  each  month's 
delivery  rate  resulted  in  the  cumulative  output. 

The  Maverick  Program 

Production  of  the  air-launched  Maverick  missile  (AGM-65) 
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occurred  from  April  1972  through  April  1978,  resulting  in 
73  data  points  (months).  Data  for  the  Maverick  program  were 
obtained  through  the  cooperation  of  personnel  at  the  Hughes 
Aircraft  Company  plant  in  Tuscon,  Arizona.  The  elements  of 
direct  labor  hours  (fabrication,  assembly,  and  test)  were 
essentially  the  same  as  for  SRAM,  with  two  notable  exceptions. 
First,  the  hours  for  testing  of  end- items  were  recorded  sep¬ 
arately  rather  than  being  included  as  part  of  assembly. 

Second,  all  labor  hours  whether  they  be  fabrication,  assembly 
or  test  were  separated  into  two  component  parts.  These  two 
components  were  called  Standard  Hours  and  the  Unit  Index. 

Standard  Hours  represented  the  number  of  hours  required 
to  perform  a  specified  task  under  ideal  conditions  as  deter¬ 
mined  by  time  and  motion  studies.  Standard  Hours  corresponded 
to  learning  that  resulted  from  methods  improvements  during  the 
life  of  the  program.  The  Unit  Index  measured  the  deviation 
between  actual  performance  and  the  ideal  standard.  The  Unit 
Index  corresponded  to  "hands  on"  labor  learning  that  occurred 
during  the  program.  When  multiplied  together.  Standard  Hours 
and  the  Unit  Index  resulted  in  actual  direct  labor  hours  used 
to  accomplish  a  major  task  (such  as  fabrication,  assembly,  or 
test) . 

The  dependent  variable,  then,  was  calculated  by  multi¬ 
plying  standard  hours  by  the  unit  index  to  obtain  direct 
labor  hours.  The  raw  data  did  not  specify  the  actual  number 
of  hours  on  a  unit  by  unit  basis,  but  averaged  the  total 
number  of  hours  expended  on  all  units  produced  during  an 
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accounting  month.  This  system  resulted  in  Maverick  labor 
hours  being  reported  on  an  equivalent  unit  basis.  Derivation 
of  the  independent  variables  was  done  in  the  same  manner  as 
for  the  SRAM  program.  The  actual  monthly  production  rate 
reported  by  Hughes  was  available  for  all  73  months  of  produc¬ 
tion.  The  production  rate  was  simply  the  number  of  missiles 
completed  during  an  accounting  month  and  was  designated  as  X2. 
Summing  each  month's  production  rate  yielded  the  cumulative 
output,  designated  as  X^. 

Eight  models  were  developed  for  the  Maverick  program 
and  were  designated  as  Models  5  through  12.  The  models  are 
discussed  below. 

Model  5.  The  dependent  variable  for  Model  5  was  desig¬ 
nated  as  Yf  and  represented  the  fabrication  portion  of  average 
total  direct  labor  hours  per  equivalent  unit.  The  independent 
variables  were  developed  as  indicated  above  for  all  eight 
models  and  are  not  discussed  here. 

Model  6.  The  dependent  variable  for  Model  6  was  desig¬ 
nated  Y  and  represented  assembly  labor  hours  per  equivalent 

a 

unit. 

Model  7.  The  dependent  variable  for  Model  7  was  desig¬ 
nated  Y  t  and  represented  test  labor  hours  per  equivalent  unit. 

Model  8.  The  dependent  variable  for  Model  8  was  desig¬ 
nated  Yt  and  represented  the  sum  of  total  direct  labor  hours 
per  equivalent  unit. 

Model  9.  The  dependent  variable  for  Model  9  was  desig¬ 
nated  Y  and  represented  the  unit  index  portion  of  total  direct 
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labor  hours  per  equivalent  unit. 


Model  10.  The  dependent  variable  for  Model  10  was 
designated  Ytsh  and  represented  the  standard  hours  posi¬ 
tion  of  total  direct  labor  hours  per  equivalent  unit. 

Model  11.  The  dependent  variable  for  Model  11  was 
designated  Yfu  and  represented  the  unit  index  portion  of  fabri¬ 
cation  hours  per  equivalent  unit. 

Model  12.  The  dependent  variable  for  Model  12  was 
designated  and  represented  the  standard  hours  posi¬ 

tion  of  fabrication  hours  per  equivalent  unit. 

_  Models  9  through  12  were  included  to  be  able  to  assess 
the  relative  effects  of  standard  hours  (methods  improvements) 
and  the  unit  index  (labor  learning  by  the  workmen) .  Total 
hours  and  fabrication  hours  were  the  only  models  evaluated  in 
this  manner  because  of  limited  computer  resources. 

Data  Treatment  Summary 

Historical  production  data  were  gathered  for  the  SRAM 
program  and  the  Maverick  program.  The  data  were  used  to 
develop  one  dependent  and  two  independent  variables  for  use 
in  multiple  linear  regression  analysis.  Various  combinations 
of  the  data  resulted  in  12  models  which  are  summarized  in 
Table  4. 


Summary 

Historical  production  data  were  analyzed  using  least 


squares  multiple  linear  regression.  The  research  hypotheses 
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TABLE  4 


Summary  of  Models  for  Regression 


Model 

Program 

Dependent  Variable 
(direct  labor  hours) 

1 

SRAM 

fabrication/minor  assembly  hours 

2 

SRAM 

major  assembly  hours 

3 

SRAM 

total  hours 

4 

SRAM 

total  hours* 

5 

Maverick 

fabrication  hours 

6 

Maverick 

assembly  hours 

7 

Maverick 

test  hours 

8 

Maverick 

total  hours 

9 

Maverick 

total  hours**  (unit  index) 

10 

Maverick 

total  hours**  (standard  hours) 

11 

Maverick 

fabrication  hours**  (unit 

index) 

12 

Maverick 

fabrication  hours**  (standard 

hours) 

*For  Model  4,  the  delivery  rate  as  recorded  on  DD  Form  250 
was  used  as  a  proxy  for  the  actual  production  rate. 

**Models  9  through  12  were  included  to  show  the  comparative 
effect  of  the  unit  index  (labor  learning  by  the  workmen) 
versus  standard  hours  (methods  improvements) . 

were  tested  using  the  statistical  and  criterion  tests  described 
in  this  chapter . 

The  first  hypothesis  was  evaluated  using  two  statistical 
tests  and  two  criterion  tests.  If  all  tests  were  passed,  the 
full  model  was  validated.  The  conclusion  sought  was  that  the 
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production  rate  explained  a  significant  amount  of  the  varia¬ 
tion  in  direct  labor  hour  requirements  for  missile  production. 


The  second  research  hypothesis  was  evaluated  using  one 
statistical  test  and  one  criterion  test.  If  both  tests  were 
passed,  the  full  model  was  shown  to  have  better  practical  pre¬ 
dictive  ability  than  the  reduced  model. 

Certain  assumptions  were  necessary  for  the  regression 
model  to  be  appropriate.  The  strength  and  validity  of  the 
conclusions  drawn  from  the  research  hypotheses  were  dependent 
on  the  applicability  of  these  assumptions.  Further,  the 
methodology  contained  certain  limitations  which  must  be  con¬ 
sidered.  A  summary  of  the  assumptions  and  limitations  follows 


Assumptions 

1.  Historical  data  obtained  from  the  manufacturer  and 
the  program  office  were  recorded  accurately. 

2.  Multicollinearity  did  not  impair  the  short-range 
predictive  ability  of  the  models. 

3.  Data  measurements  and  transformations  were  accurate 

4.  No  significant  loss  of  data  precision  was  induced 
by  the  logarithmic  transformation  of  the  data  used  to  facili¬ 
tate  multiple  linear  regression. 

5.  The  error  terms  had  a  normal  distribution  with  a 
mean  of  zero,  constant  variance,  and  were  statistically  inde¬ 
pendent. 

Limitations 

1.  Subjective  analysis  was  required  to  assess  the 
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validity  of  the  assumption  concerning  constant  variance  of 
error  terms. 

2.  Information  derived  from  the  data  for  a  specific 
program  can  be  applied  only  to  that  program. 

Having  employed  the  methodology  just  described.  Chapter 
IV  presents  the  results  of  the  data  analysis  and  evaluation. 
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CHAPTER  IV 


DATA  ANALYSIS  AND  EVALUATION 

This  chapter  presents  analysis  of  production  data  for 
the  two  missile  programs  utilizing  the  methodology  described 
in  Chapter  III.  It  is  divided  into  three  sections,  beginning 
with  analysis  of  the  SRAM  data  in  Models  1  through  4.  The 
next  section  discusses  analysis  of  the  Maverick  data  with 
Models  5  through  12.  Each  of  these  sections  describes  the 
production  program,  the  data,  results  of  hypothesis  testing, 
and  major  findings.  The  last  section  summarizes  the  findings 
for  both  production  programs,  compares  and  contrasts  them, 
and  evaluates  the  overall  applicability  of  the  full  model 
to  the  two  programs . 


The  SRAM  Program 

As  stated  in  Chapter  III,  the  data  for  SRAM  program 
analysis  were  obtained  from  two  sources.  The  Boeing  Company 
provided  the  data  for  the  dependent  variable,  direct  labor 
hours  per  missile.  The  Strategic  Systems  Program  Office 
provided  the  data  for  the  independent  variables,  cumulative 
production  and  production  rate.  Fifteen  hundred  missiles 
were  manufactured  with  no  breaks  in  production  from  February 
1972  to  August  1975,  a  total  of  42  months.  As  described  in 
Chapter  III,  there  were  time  gaps  in  the  production  rate  data 
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that  allowed  use  of  only  22  of  the  42  possible  data  points. 
Because  this  sample  was  used  instead  of  a  census,  confidence 
in  the  analysis  results  was  decreased  somewhat  due  to  the 
possibility  of  sampling  error.  However,  the  sample  size  was 
large  enough  to  generalize  the  analysis  results  to  the  popu¬ 
lation. 

Aside  from  the  potential  sampling  error  problem  des¬ 
cribed  above,  the  SRAM  program  provided  a  good  test  situation 
for  the  research.  The  total  direct  labor  data  were  broken 
down  into  two  major  components,  fabrication/minor  assembly  and 
major  assembly.  This  partitioning  of  the  total  labor  hours 
permitted  the  researchers  to  assess  the  differing  effects  of 
the  production  rate  on  the  two  different  aspects  of  labor. 
Additionally,  the  cumulative  output  and  production  rate  data 
reflected  actual  results  experienced  on  the  production  line. 

As  a  consequence,  development  of  a  less  accurate  production 
rate  proxy  was  not  required.  Finally,  the  SRAM  production 
history  did  not  reveal  any  major  design,  production,  or 
accounting  changes. 

The  raw  data  were  transformed  as  described  in  the  ex¬ 
planation  of  the  individual  variables  for  each  of  the  models 
presented  in  Chapter  III.  Regression  analysis  was  performed 

on  both  the  reduced  and  full  forms  of  the  models,  and  test 

? 

statistics  were  calculated.  The  test  statistics  were  then 


^The  primary  regression  results  used  throughout  this 
research  were  obtained  through  use  of  Smith's  FORTRAN  IV  pro¬ 
gram  which  was  extensively  modified  by  the  authors.  This 
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compared  with  the  critical  values  required,  and  the  criterion 
tests  were  applied  to  determine  if  the  first  research  hypothe¬ 
sis  was  supported.  If  the  results  for  a  particular  model 
supported  research  hypothesis  one  and  the  criterion  tests 
failed  to  reject  the  model  as  inappropriate,  that  model  was 
then  tested  for  support  of  research  hypothesis  two.  Even  if 
the  model  was  rejected  as  inappropriate  under  research  hypo¬ 
thesis  one,  tests  for  research  hypothesis  two  were  presented 
for  subjective  evaluation,  recognizing  that  statistical  infer¬ 
ences  could  not  be  made  with  confidence. 

Analysis  of  Research 
Hyp  o  thesis  One" 

The  statistical  hypotheses  and  criterion  tests  for 
research  hypothesis  one  are  restated  below  in  summary  form 
for  ease  of  reference. 

Research  Hypothesis  One.  The  production  rate  explains 
a  significant  portion  of  the  variation  in  total  direct  labor 
requirements  for  missile  production  when  included  in  an 
appropriate  model. 

Statistical  Hypothesis  One  (A).  HQ :  and  S2  *  0; 

H^:  8^  t  0  and/or  S2  f  0.  Reject  Hg  if  F  Ratio  is  greater 

than  Fc. 


modified  program  is  listed  and  described  in  the  Appendix.  A 
similar  program  is  available  for  use  by  government  price 
analysts  through  the  COPPER  IMPACT  Library  under  the  file  name 
PRODRATE . 
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Statistical  Hypothesis  One  (B) .  Hg :  82  *  0; 

:  S2  i  0;  reject  Hg  if  F*  is  greater  than  F  . 

Criterion  Test  One  (A) .  The  model's  appropriateness 
cannot  be  rejected  if  an  analysis  of  the  residuals  indicates 
the  assumptions  of  constant  variance,  independence,  and 
normality  are  not  violated. 

Criterion  Test  One  (B) .  The  model's  appropriateness 
cannot  be  rejected  if  the  computed  R  (actual)  is  greater 
than  75  percent. 

Test  results  for  research  hypothesis  one  are  presented 
in  tabular  format  for  each  model  tested.  Recall  that  Models 
1,  2,  and  3  have  the  same  values  for  the  independent  variables 
(plant  actuals)  but  different  dependent  variables;  fabrication/ 
minor  assembly,  major  assembly,  and  total  direct  labor  hours, 
respectively.  Also  recall  that  Model  4  has  the  same  dependent 
variable  as  Model  3  (total  direct  labor  hours) ,  but  uses  a 
proxy  for  the  production  rate  variable  (delivery  rate  to  desti¬ 
nation;  e.g.  B-52  Wing,  as  shown  on  DD  Form  250).  To  insure 
these  distinctions  remain  clear,  each  model  is  briefly  re¬ 
stated  prior  to  presentation  of  the  test  results. 

Model  1,  The  results  of  Model  1  are  contained  in 
Table  5.  Reduced  model: 


or  in  logarithmic  form: 

Log  (Yf)  -  Log  (SQ)  ♦  S1  •  Log  (X1) 


Full  model: 


TABLE  5 


Research  Hypothesis  One  Results* 

SRAM  Model  1 

Fabrication  and  Minor  Assembly  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Mod.'l 

Estimated  6^ 

177S. 21 

1881.92 

Estimated  3^ 

-0.20 

-0.19 

Estimated  0 ^ 

-- 

-0.04 

F  Ratio 

228.71 

110. 65 

F  Critical  (2  ,  19) 

3.52 

Statistical  Hypothesis  1A 

Reject  H0 

F  Statistic 

.32 

F  Critical  (1,  19) 

4.38 

Statistical  Hypothesis  IB 

“  “ 

Fail  to 
Reject  Hq 

Residual  Plot 

Acceptable 

KS  Statistic 

.  19 

KS  Critical 

.  29 

Durbin-Watson  Statistic 

1.51 

Durbin-Watson  Crit.  (d  /d, ) 

1.15/1.67 

Criterion  Test  1A 

Passed 

R2  (Log) 

.920 

.921 

R^  (Actual) 

.928 

.927 

Criterion  Test  IB 

Passed 

Resid.  Analysis 

Mean  -  3 . V  5 

KS  Statistic  *  .189  <  KS,_  of 

.  290  Normal 

nistrib. 

Constant  Variance  -  OK 

Autocorr.  -  No 

♦Certain  table  values  may  be  masked  in  the  published  ver- 

sion  of  this  thesis  because  these  data  elements  are 
considered  proprietary  by  the  manufacturer. 
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or  in  logarithmic  form: 

Log  (Yf)  -  Log  (S0)  ♦  S:  •  Log  (Xj)  +  S2  •  Log  (X2) 
where : 

Y^  ■  fabrication  and  minor  assembly  direct  labor  hours/ 
unit/accounting  month, 

X^  .»  cumulative  output  plot  point  (cumulative  units  at 
end  of  accounting  month), 

X2  *  production  rate/accounting  month. 

Model  2.  The  results  of  Model  2  are  contained  in 
Table  6.  Reduced  model: 


or  in  logarithmic  form: 

Log  (Ya)  -  Log  (S0)  ♦  3X  •  Log  (X^ 

Full  model: 


or  in  logarithmic  form: 

Log  (Ya)  »  Log  (30)  +  3 :  •  Log  (Xj)  ♦  6,  •  Log  (X2) 
where : 

Y  *  major  assembly  direct  labor  hours/unit/accounting 

cL 

month, 

X^  *  cumulative  output  plot  point  (cumulative  units  at 
end  of  accounting  month). 

X2  *  production  rate/accounting  month. 


SO 


TABLE  6 


Research  Hypothesis  One  Results 
SRAM  Model  2 


Major  Assembly  Hours  Per  Unit 


Test  Items 


Reduced  Full 

Model  Model 


Estimated  SQ  1863.19 

Estimated  -0.39 

Estimated  62 

F  Ratio  1796.53 

F  Critical  (2,  19) 

Statistical  Hypothesis  1A 

F  Statistic 
F  Critical  (1,  19) 

Statistical  Hypothesis  IB 


Residual  Plot 
KS  Statistic 
KS  Critical 

Durbin- Watson  Statistic 
Durbin-Watson  Crit.  (d  ,/dT ) 

Criterion  Test  1A 

R2  (Log)  .990 

R“  (Actual)  .996 

Criterion  Test  IB 


1890.33 

-0.39 

-0.01 

855.18 

3.52 

Reject  Hq 

.04 

4.38 

Fail  to 
Reject  Hq 


Unacceptable 


.09 

.29 

1.14 

1.15/1.67 


Failed 


.989 

.996 


Passed 


Res  id.  Analysis 
Mean  *  T34 

KS  Statistic  *  .  094  <  KS  of  .  290  Normal  Distrib. 
Constant  variance  -  No  -Most  terms  within  1  std  error, 

but  snaking  pattern 

Autocorr.  -  Indecisive 


Model  3.  The  results  of  Model  3  are  contained  in 
Table  7.  Reduced  model: 


or  in  logarithmic  form: 

Log  (Y t)  -  Log  (Bq)  +  Bx  •  Log  (Xx) 

Full  model: 


or  in  logarithmic  form: 

Log  (Yt)  *  Log  (Bq)  +  B1  *  Log  (X^  +  B2  •  Log  (X2) 
where : 

Y  -  total  direct  labor  hours/unit/accounting  month, 
X^  ■  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month), 

X2  =  production  rate/accounting  month. 

Model  4.  The  results  of  Model  4  are  contained  in 
Table  8.  Reduced  model: 


or  in  logarithmic  form: 

Log  (Yt)  =■  Log  (Sq)  +  3  L  •  Log  (X^ 

Full  model: 


or  in  logarithmic  form: 

Log  C Y t )  »  Log  ( 3q)  +  3 1  •  Log  (X^  +  32  •  Log  (X2) 
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TABLE  7 


Research  Hypothesis  One  Results 
SRAM  Model  3 
Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  Sq 

3366.71 

3S20.65 

Estimated  8^ 

-0.26 

-0.25 

Estimated  82 

-0.03 

F  Ratio 

735.51 

356.36 

F  Critical  (2,  19) 

3.52 

Statistical  Hypothesis  1A 

Reject  Hq 

F  Statistic 

.37 

F  Critical  (1,  19) 

4.38 

Statistical  Hypothesis  IB 

**  “ 

Fail  to 
Reject  Hq 

Residual  Plot 

-- 

Acceptable 

KS  Statistic 

.22 

KS  Critical 

.  29 

Durbin-Watson  Statistic 

1.35 

Durbin-Watson  Crit.  (d  / dT ) 

v  u  L 

1.15/1.67 

Criterion  Test  1A 

Passed 

R2  (Log) 

.  973 

.974 

R^  (Actual) 

.  975 

.975 

Criterion  Test  IB 

— 

Passed 

Resid.  Analysis 
Mean  *  3.91 

KS  Statistic  »  .222  <  KS  of  .29  Normal  Distrib. 
Constant  Variance  -  OK,  Some  resid  values  larger  for 

larger  values  of 


Autocorr . 


Indecisive 


TABLE  8 


Research  Hypothesis  One  Results 
SRAM  Model  4 


Total  Hours  Per  Unit  with 

DD2S0  Delivery 

Rate  Proxy 

Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  8g 

3184.85 

3614.84 

Estimated  8^ 

-0.25 

-0.24 

Estimated  6^ 

-- 

-0.06 

F  Ratio 

927.60 

464.89 

F  Critical  (2,  40) 

3.23 

Statistical  Hypothesis  1A 

Reject  Hq 

F  Statistic 

1.05 

F  Critical  (1,  40) 

4.08 

Statistical  Hypothesis  IB 

“  “ 

Fail  to 
Reject  H 

0 

Residual  Plot 

Acceptable 

KS  Statistic 

.29 

KS  Critical 

.29 

Durbin-Watson  Statistic 

.51 

Durbin-Watson  Crit.  (du/d^) 

1.15/1.67 

Criterion  Test  1A 

Failed 

R2  (Log) 

.959 

.960 

R^  (Actual) 

.938 

.944 

Criterion  Test  IB 

Passed 

Resid.  Analysis 
Mean  *  3.98 

KS  Statistic  *  .286  <  KS  of  .  290  Normal  Distrib. 
Constant  Variance  -  OK  c 
Autocorr.  -  Yes 
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where : 

Yt  ■  total  direct  labor  hours/unit/accounting  month, 

*  cumulative  output  plot  point  (cumulative  units  at 
end  of  accounting  month), 

*  production  rate  proxy/accounting  month  (delivery 
rate  to  final  destination  -  DD250). 

Research  Hypothesis  One 
Analysis  Summary 

As  shown  in  Tables  5  through  8,  all  four  models  indi¬ 
cated  a  potential  for  supporting  research  hypothesis  one. 

Very  high  R  values  were  evident  in  both  the  reduced  and  full 
forms  of  the  model,  thereby  passing  all  F-tests  for  statistical 
hypothesis  LA.  Both  the  full  and  reduced  forms  of  each  model 
proved  to  be  significant  explainers  of  the  variation  in  the 
dependent  variable;  however,  the  production  rate  variable  did 
not  add  significantly  to  this  explanatory  ability.  The  high 
R^  values  for  the  reduced  model  coupled  with  the  small  change 
in  R^  when  the  production  rate  variable  was  added,  demonstrated 
the  greater  strength  of  the  cumulative  output  variable  for  ex¬ 
plaining  variation  in  the  dependent  variable. 

The  results  of  the  appropriateness  tests  were  mixed. 
Models  1  and  3  met  all  assumptions  while  Model  2  passed  the  nor¬ 
mal  distribution  assumption,  but  failed  the  constant  variance 
and  independent  error  terms  tests.  Model  4  did  not  satisfy 
the  assumption  of  independent  error  terms. 

One  of  the  primary  reasons  for  including  Model  4  in  the 
research  was  to  investigate  the  degree  of  sampling  error 
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inherent  in  utilizing  only  22  data  points  out  of  the  popula- 
tion  of  42  for  SRAM.  The  R  and  coefficient  values  in  Model 
4,  which  utilized  a  census  of  the  total  42-point  population, 
differed  only  slightly  from  those  of  Models  1  and  3.  There¬ 
fore,  the  concern  over  possible  sampling  error  was  eased. 

To  summarize,  two  models  were  found  appropriate  for 
the  SRAM  data,  Models  1  and  3.  Addition  of  the  production 
rate  variable  did  not  significantly  increase  the  explanatory 
ability  of  the  already  strong  reduced  model.  Research  hypo¬ 
thesis  one  for  the  SRAM  program  was,  therefore,  not  supported. 

Analysis  of -Research 
Hypothesis  Two 

Models  1  and  3  passed  the  appropriateness  tests  and 
were,  therefore,  validated  for  predictability  testing  under 
research  hypothesis  two.  Because  Models  2  and  4  were  not 
deemed  appropriate  under  research  hypothesis  one,  statistical 
inference  for  these  models  was  not  possible.  However,  the 
predictive  ability  calculations  for  them  are  presented  for 
subjective  evaluation.  Even  with  statistical  inference  lack¬ 
ing,  it  may  be  useful  to  know  whether  or  not  good  predictive 
ability  results  were  obtained. 

Analysis  of  the  predictive  ability  of  the  SRAM  models 
was  conducted  using  the  computer  program  listed  in  the  Appendix. 
This  program  contains  an  option  that  permits  the  researcher  to 
perform  stepwise  truncation  of  input  data  points  and  simulate 
predictions  of  direct  labor  requirements.  Predicted  values 
are  compared  with  the  observed  values  and  any  deviation  is 
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computed  both  as  an  absolute  deviation  and  as  a  percentage  of 
the  observed  value.  Since  this  process  is  carried  out  simul¬ 
taneously  for  both  the  full  and  reduced  models,  it  permits  a 
comparison  of  the  predictive  ability  of  the  reduced  model  with 
the  full  model  (16:66). 

For  example,  if  the  input  data  base  contains  22  data 
points  (as  in  the  case  of  the  SRAM  data) ,  the  last  data  point 
(case  number  22)  is  truncated.  One  limitation  of  the  model  is 
that  truncation  cannot  step  backward  beyond  the  total  number 
of  data  points  divided  by  two,  plus  two.  So  for  SRAM,  simu¬ 
lating  12  months  of  prediction  was  impossible.  The  maximum 
number  of  data  points  (months)  that  could  be  truncated  for 
SRAM  was  nine  (i.e.,  22  *  2  -  11,  11  ♦  2  -  13,  22  -  13  -  9, 

the  maximum  number  of  data  points  that  could  be  truncated  with 
22  total  data  points).  Continuing  with  the  procedure,  regres¬ 
sion  coefficients  are  computed  for  the  full  and  reduced  models 
using  22  data  points  and  these  coefficients  are  used  to  predict 
the  direct  labor  requirements  for  case  number  22.  The  predicted 
values  for  the  full  and  reduced  models  are  subtracted  from  the 
observed  values  and  the  absolute  value  of  the  resulting  devia¬ 
tions  is  stored  in  an  array  for  use  in  the  test  of  statistical 
hypothesis  two.  The  deviation  is  also  divided  by  the  observed 
value  and  multiplied  by  100  to  arrive  at  a  percentage  devia¬ 
tion  for  use  in  criterion  test  two. 

The  above  process  is  repeated  for  case  number  21  using 
the  original  data  base  truncated  to  20,  19,  .  .  .,  etc.  data 
points.  The  stepwise  truncation  continues  until  a  prediction 
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of  case  number  22  has  been  made  from  data  points  nine  months 
prior  to  case  number  22,  and  the  entire  procedure  is  repeated 
for  cases  22  through  13.  In  data  bases  where  the  data  points 
represent  one-month  intervals,  this  procedure  results  in  81 
test  situations  and  provides  a  subjective  test  of  a  model's 
predictive  ability  (16:67). 

This  procedure  is  illustrated  in  the  third  section  of 
the  Appendix  which  contains  a  computer  printout  of  a  sample 
situation  using  simulated  data. 

The  statistical  hypothesis  and  criterion  test  for 
research  hypothesis  two  are  summarized  and  restated  as  follows. 

Research  Hypothesis  Two.  For  12  months  into  the  future, 
the  predictive  ability  of  the  full  model  is  better  than  the 
predictive  ability  of  the  reduced  model. 

Statistical  Hypothesis  Two.  HQ :  |FR|  <  |Up|; 

H!:  |ffRl  >  |Bp|.  Reject  Hfl  if  t  >  tc  (.05). 

Criterion  Test  Two.  The  model  with  the  greater  total 
number  of  good  (within  10  percent)  and  excellent  (within  5 
percent)  predictions  over  the  range  of  all  test  situations 
will  be  deemed  the.  model  with  the  better  predictive  ability. 

Research  Hypothesis  Two 
Analysis  Summary 

Tables  9  through  12  summarize  the  predictive  ability 
tests  conducted  for  Models  1  through  4  of  the  SRAM  data.  Since 
Models  1  and  3  were  the  only  ones  found  appropriate  for  the 
data,  statistical  inferences  were  made  only  for  them.  The 
12-month  prediction  simulation  for  Models  1  and  3  demonstrated 
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TABLE  9 


Research  Hypothesis  Two  Results 
SRAM  Model  1 

Fabrication  and  Minor  Assembly  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

27.40 

30.16 

Variance 

969.64 

1541.42 

t  Test  Statistic 

-0.49 

t  Critical 

-1.72 

Statistical  Hypothesis  Two 

Fail  to 
Reject  Hq 

Total  number  of  test  situations 

81 

81 

Total  number  of  excellent 

predictions  (within  5  percent) 

60 

58 

Total  number  of  good  predic¬ 
tions  (within  10  percent) 

67 

66 

Criterion  Test  Two 

-- 

Passed 

excellent  predictive  ability  for  both  the  reduced  and  full 
forms  of  the  model.  The  reduced  model  appeared  to  be  a 
slightly  better  predictor,  but  this  could  not  be  shown  statis¬ 
tically  because  the  computed  t  statistic  did  not  exceed  the 
t  critical  value  for  Model  1  or  3.  Again,  the  strength  of 
the  cumulative  output  variable  may  have  masked  the  real 
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TABLE  10 


Research  Hypothesis  Two  Results 


SRAM  Model  2 

Major  Assembly  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

8.71 

9.45 

Variance 

19.61 

25.61 

t  Test  Statistic 

-- 

-1.00 

t  Critical 

-- 

-1.72 

Statistical  Hypothesis  Two 

Fail  to 
Reject  Hq 

Total  number  of  test  situations 

81 

81 

Total  number  of  excellent 

predictions  (within  5  percent) 

19 

18 

Total  number  of  good  predic¬ 
tions  (within  10  percent) 

66 

58 

Criterion  Test  Two 

Passed 

contribution  of  the  production  rate  variable  to  the  model. 

The  same  basic  results  are  demonstrated  in  Models  2  and  4, 
but  statistical  inference  was  not  possible  with  them  be¬ 
cause  they  were  deemed  inappropriate  under  research  hypothesis 
one . 
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TABLE  11 


Research  Hypothesis  Two  Results 
SRAM  Model  3 
Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

30.24 

33.01 

Variance 

871.17 

1497.29 

t  Test  Statistic 

--  . 

-0.51 

t  Critical 

-1.72 

Statistical  Hypothesis  Two 

Fail  to 
Reject  Hq 

Total  number  of  test  situations 

81 

81 

Total  number  of  excellent 

predictions  (within  5  percent) 

44 

46 

Total  number  of  good  predic¬ 
tions  (within  10  percent) 

68 

67 

Criterion  Test  Two 

Passed 

In  summary,  all  models  exhibited  excellent  predictive 
ability  and  passed  criterion  test  two  as  a  result.  All  models 
failed  to  reject  the  null  hypothesis  under  statistical  hypo¬ 
thesis  two,  so  the  predictive  ability  of  the  reduced  and  full 
forms  of  the  model  could  not  be  inferred  to  be  statistically 
different.  Therefore,  research  hypothesis  two  was  not  con¬ 
sidered  supported  for  the  SRAM  data. 
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TABLE  12 


Research  Hypothesis  Two  Results 
SRAM  Model  4 

Total  Hours  Per  Unit  with  DD250  Delivery  Rate  Proxy 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

23.17 

29.10 

Variance 

231.45 

586.97 

t  Test  Statistic 

-2.78 

t  Critical 

-- 

-1.72 

Statistical  Hypothesis  Two 

-- 

Fail  to 
Reject  HQ 

Total  number  of  test  situations 

180 

180 

Total  number  of  excellent 
predictions  (within  S  percent) 

112 

95 

Total  number  of  good  predic¬ 
tions  (within  10  percent) 

176 

161 

Criterion  Test  Two 

Passed 

The  Maverick 

Data 

The  data  furnished  by  the  Hughes  Aircraft  company  con¬ 
sisted  of  total  direct  labor  requirements  and  production 
history  for  the  total  Maverick  missile.  Full-scale  produc¬ 
tion  commenced  April  1972  and  continued  without  interruption 
through  May  1978  (73  months) ,  resulting  in  the  manufacture  of 
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approximately  26,500  units.  Because  the  data  reflected  signi¬ 
ficant  fluctuation  in  the  production  rate,  the  program  provided 
an  excellent  test  situation  for  the  research.  Like  SRAM,  the 
Maverick  data  were  broken  down  into  several  major  components 
--fabrication,  assembly,  and  test.  Once  again,  this  parti¬ 
tioning  of  total  direct  labor  hours  permitted  evaluation  of 
the  differing  effects  of  the  production  rate  on  these  differ¬ 
ent  elements  of  labor.  The  production  rate  and  cumulative 
output  data  were  based  on  actuals  experienced  in  the  Tucson 
AZ  plant;  thus,  no  proxy  for  the  production  rate  was  required. 
Also,  no  significant  technological,  production,  or  accounting 
changes  occurred  during  the  program. 

One  intriguing  aspect  of  the  Maverick  data  was  the 
manner  in  which  the  manufacturer  accounted  for  direct  labor 
hours  in  the  three  categories  described  above.  As  mentioned 
in  Chapter  III,  direct  labor  hours  were  segmented  into  two 
components:  Unit  Index  and  Standard  Hours.  On  a  continuing 

basis,  Hughes  conducted  time  and  motion  studies  to  estimate 
how  many  hours  it  would  take  to  manufacture  each  missile 
under  "ideal"  conditions  at  a  particular  point  in  the  produc¬ 
tion  program.  This  estimate  was  called  Standard  Hours,  and 
its  evolution  over  time  represented  a  measure  of  methods 
improvement.  For  each  month  of  production,  Hughes  computed 
a  Unit  Index  reflecting  the  deviation  between  the  actual 
number  of  direct  labor  hours  required  for  production  and 
the  number  of  hours  that  would  be  required  under  ideal  con¬ 
ditions.  Whenever  the  actual  number  of  hours  required  for 


63 


production  achieved  the  "ideal"  standard,  the  Unit  Index  was 
equal  to  one.  Any  value  of  the  index  greater  than  one  re¬ 
flected  less  than  ideal  performance.  The  evolution  of  the 
index  over  time  represented  a  measure  of  labor  improvement  or 
learning.  To  calculate  direct  labor  hours  per  missile,  the 
Unit  Index  was  multiplied  by  the  Standard  Hours.  For  example 
assume  the  program  is  in  the  early  stages  of  production,  the 
Standard  Hours  are  100  hours  per  unit  and  the  Unit  Index  2.50 
per  unit  (less  than  perfect  conditions).  The  two  are  then 
multiplied  to  calculate  total  hours  per  missile  of  250,  each 
describing  a  different  aspect  of  labor.  As  one  might  expect, 
the  Unit  Index,  Standard  Hours,  and  direct  labor  hours  ex¬ 
hibited  learning  trends  to  varying  degrees.  Because  of 
this  unique  accounting  procedure,  the  researchers  were  able 
to  assess  the  effects  of  the  production  rate  on  both  the 
"labor  learning"  and  "methods  improvement"  aspects  of  direct 
labor. 

The  raw  Maverick  production  data  were  treated  as 
described  in  the  explanation  of  individual  variables  for  each 
of  the  models  presented  in  Chapter  III.  Regression  analysis 
technique,  statistical  hypothesis  testing,  and  criterion  test 
ing  for  research  hypotheses  one  and  two  were  performed  in 
exactly  the  same  manner  as  performed  on  the  SRAM  data. 

Analysis  of  Research 
Hypothesis  One 

Once  again,  to  insure  the  distinctions  among  models 
remain  clear,  each  model  is  briefly  restated  prior  to  the 
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tabular  presentation  of  the  test  results. 

Model  5.  The  results  of  Model  5  are  contained  in 


Table  13.  Reduced  model: 


8- 


Yf  3  so  •  xi 

or  in  logarithmic  form: 

Log  (Yf)  -  Log  (B q)  +  Sj.  •  Log  (X.^ 


Full  model: 


B  i  B  2 

Yf  *  B0  *  X1  X2 


or  in  logarithmic  form: 

Log  (Yf)  «  Log  (3 q)  +  8X  •  Log  (Xj)  +  B2  “  Log  (X7) 
where : 

Y^  *  fabrication  direct  labor  hours/equivalent  unit/ 
accounting  month, 

X^  =  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month), 

X7  *  production  rate/accounting  month. 

Model  6.  The  results  of  Model  6  are  contained  in 


Table  14.  Reduced  model: 


Y  *  3  •  X 

a  0  A1 


or  in  logarithmic  form: 

Log  (Ya)  -  Log  (S0)  +  Sx  •  Log  (X1) 


Full  model: 


31  S2 

Ya  *  So  '  X1  X2 
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TABLE  13 


Research  Hypothesis  One  Results 
Maverick  Model  5 


Fabrication  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  3g 

126.16 

142.92 

Estimated  8^ 

-0.13 

-0.12 

Estimated  8^ 

-0.04 

F  Ratio 

241.27 

131.21 

F  Critical  (2,  70) 

-- 

3.15 

Statistical  Hypothesis  1A 

Reject  HQ 

F  Statistic 

5.53 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

Reject  Hq 

Residual  Plot 

Acceptable 

KS  Statistic 

.  15 

KS  Critical 

.16 

Durbin-Watson  Statistic 

1.91 

Durb in- Watson  Crit.  (du/d^) 

1.55/1.67 

Criterion  Test  1A 

Passed 

R2  (Log) 

.773 

.789 

R2  (Actual) 

.797 

.807 

Criterion  Test  IB 

Passed 
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or  in  logarithmic  form: 


Log  (Ya)  -  Log  (S0)  +  B1  •  Log  (X^  +  $2  *  Lo8 
where : 

Y  *  assembly  direct  labor  hours/equivalent  units/ 

a 

accounting  month, 

X^  *  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month), 

*  production  rate/accounting  month. 

Model  7.  The  results  of  Model  7  are  contained  in 
Table  15.  Reduced  model: 


or  in  logarithmic  form: 

Log  (Ytst)  *  Log  (8  q)  +  3X  "  Log  (Xj_) 

Full  model: 


Ytst  “  30 


B.  3, 

X  1  «  X  “ 
1  ,v2 


or  in  logarithmic  form: 

Log  (Ytst)  =  Log  (30)  ♦  •  Log  (X^  *  S2  •  Log  (X2) 


where : 

Y  t  *  test  direct  labor  hours/equivalent  unit/ 
accounting  month, 

X^  *  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) » 

X^  »  production  rate/accounting  month. 

6  7 


TABLE  14 


Research  Hypothesis  One  Results 
Maverick  Model  6 
Assembly  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  Sg 

901.59 

998.02 

Estimated 

-0.30 

-0.28 

Estimated  S., 

-- 

-0.05 

F  Ratio 

777.93 

401.41 

F  Critical  (2,  70)  . 

3.15 

Statistical  Hypothesis  1A 

Reject  HQ 

F  Statistic 

3.00 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

*  - 

Fail  to 
Reject  Hg 

Residual  Plot 

Acceptable 

KS  Statistic 

.33 

KS  Critical 

.16 

Durbin-Watson  Statistic 

.79 

Durbin-Watson  Crit  (d  /d.  ) 

U  L 

1.55/1.67 

Criterion  Test  1A 

Failed 

R2  (Log) 

.916 

.920 

R2  (Actual) 

.837 

.811 

Criterion  Test  IB 

-- 

Passed 

Resid.  Analysis 

Mean  *  -.482 

KS  Statistic  *  .3271  >  KS  Of 
Constant  Variance  -  Yes 
Autocorr.  -  Yes 

.159  Not 

Normal  Distrib. 
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TABLE  IS 


Research  Hypothesis  One  Results 
Maverick  Model  7 
Test  Hours  Per  Unit 


Test  Item 

Reduced 

Model 

Full 

Model 

Estimated  3  q 

150.84 

170.37 

Estimated  B  ^ 

-0.27 

-0.22 

Estimated  0 ^ 

-0.11 

F  Ratio 

353.26 

188.53 

F  Critical  (2,70) 

3.15 

Statistical  Hypothesis  1A 

-- 

Reject  Hq 

F  Statistic 

4.82 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

Reject  Hq 

Residual  Plot 

Acceptable 

KS  Statistic 

.38 

KS  Critical 

.  16 

Durb in-Watson  Statistic 

.81 

Durbin-Watson  Crit.  (du/dL) 

1.55/1.67 

Criterion  Test  1A 

Failed 

R2  (Log) 

.  833 

.843 

R2  (Actual) 

.551 

.500 

Criterion  Test  IB 

Failed 

Resid.  Analysis 
Mean  *  .68 

KS  Statistic  ■  .381  >  KS  of  .159  •**  Not  Normal  Distrib 
Constant  Variance  -  Marginal,  Slight  Pattern 

Persistence 


Autocorr . 


Yes 


Model  8.  The  results  of  Model  8  are  contained  in 


Table  16.  Reduced  model: 


or  in  logarithmic  form: 

Log  (Yt)  *  Log  (B0)  +  B1  *  Log  (X^ 

Full  model: 


or  in  logarithmic  form: 

Log  (Yt)  *  Log  (B0)  *  Sj_  •  Log  (Xj)  +  *  Log  (X^) 

where:  . 

Y  ■  total  direct  labor  hours/equivalent  unit/ 
accounting  month, 

X.^  -  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month), 

X,  *  production  rate/accounting  month. 

Model  9.  The  results  of  Model  9  are  contained  in 
Table  17.  Reduced  model: 


or  in  logarithmic  form: 


Log  (Ytu^  *  Log  CB0>  +  Sx  •  Log  (X:) 


Full  model 


8i  S? 
Y  *  a  .  X  •  X  L 
ltu  B0  1  A2 
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TABLE  16 


Research  Hypothesis  One  Results 
Maverick  Model  8 


Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  gg 

735.62 

740.27 

Estimated  8^ 

-0.21 

-0.21 

Estimated  g7 

-0.01 

F  Ratio 

854.57 

421.59 

F  Critical  (2,  70) 

-- 

3.15 

Statistical  Hypothesis  1A 

Reject  Hg 

F  Statistic 

-- 

.05 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

Fail  to 

Reject  HQ 

Residual  Plot 

Acceptable 

KS  Statistic 

-- 

.  33 

KS  Critical 

.16 

Durbin-Watson  Statistic 

.63 

Durbin-Watson  Crit.  (d^/d^) 

1.55/1.67 

Criterion  Test  1A 

Failed 

Rj  (Log) 

.923 

.923 

R“  (Actual) 

.850 

.846 

Criterion  Test  IB 

Passed 

Resid.  Analysis 

Mean  *  - . 028 

KS  Statistic  ■  .  329  >  KS  of  .159  •••  Not  Normal  Distrib 
Constant  Variance  -  Marginal,  slight  pattern 
Autocorr.  -  Yes 
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or  in  logarithmic  form: 

Log  (Ytu)  »  Log  C80)  *  •  Log  (Xx)  +  S2  •  Log  (X2) 


where : 

Y  ■  Unit  Index  portion  of  total  hours/equivalent 
unit/accounting  month, 

X^  -  cumulative  output  plot  point  (cumulative 
units  at  end  of  accounting  month), 

X^  *  production  rate/accounting  month. 

Model  10.  The  results  of  Model  10  are  contained  in 
Table  18.  Reduced  model: 


Ytsh  *  S0  ‘  X1 


or  in  logarithmic  form: 


Full  Model 


Log  (Ytsh3  *  L°S  (Sq)  +  *  Log  (Xx) 


31  32 

Ytsh  *  80  *  X1  *  X2 


or  in  logarithmic  form: 


Log  (Ytsh)  *  Log  (SQf  +>  8X  •  Log  (X,)  +  32  •  Log  (X,) 


where : 


Yts^  *  Standard  Hours  portion  of  total  direct  labor 
hours/equivalent  unit/accounting  month, 

X^  *  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month, 

X2  *  production  rate/accounting  month. 
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TABLE  17 


Research  Hypothesis  One  Results 
Maverick  Model  9 


Unit  Index  for  Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  8g 

36.48 

41.03 

Estimated 

-0.19 

-0.13 

Estimated  S ^ 

-- 

-0.10 

F  Ratio 

399.81 

237.82 

F  Critical  (2,  70) 

3.15 

Statistical  Hypothesis  1A 

Reject  HQ 

F  Statistic 

12.28 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

Reject  Hg 

Residual  Plot 

Acceptable 

KS  Statistic 

.32 

KS  Critical 

.16 

Durbin-Watson  Statistic 

-- 

.59 

Durbin-Watson  Crit.  (du/d^) 

1.55/1.67 

Criterion  Test  1A 

-- 

Failed  • 

R2  (Log) 

.849 

.  872 

R2  (Actual) 

.752 

.705 

Criterion  Test  IB 

Failed 

Resid.  Analysis 

Mean  *  .081 

KS  Statistic  *  .315  >  KS 

of  .  159  Not 

Normal  Distrib 

Constant  Variance  -  OK  - 

cSlight  Pattern 

Autocorr.  -  Yes 
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TABLE  18 


Research  Hypothesis  One  Results 
Maverick  Model  10 

Standard  Hours  for  Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  8g 

78.96 

72.36 

Estimated  8^ 

-0.05 

-0.09 

Estimated  3^ 

-- 

0.08 

F  Ratio 

223.84 

394.19 

F  Critical  (2,  70) 

-- 

3.15 

Statistical  Hypothesis  1A 

Reject  Hq 

F  Statistic 

136.71 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

-- 

Reject  Hg 

Residual  Plot 

Acceptable 

KS  Statistic 

.05 

KS  Critical 

-- 

.16 

Durb in-Watson  Statistic 

1.66 

Durbin-Watson  Crit.  (d^/d^) 

1.55/1.67 

Criterion  Test  1A 

Passed 

R2  (Log) 

.  759 

.918 

R2  (Actual) 

.752 

.912 

Criterion  Test  IB 

Passed 

Resid.  Analysis 

Mean  *  .096 

KS  Statistic  *  .053  <  KS 
Constant  Variance  -  Yes 
Autocorr.  -  No 

of  .  159  Normal 

Excellent 

Distrib . 

I 


Model  11.  The  results  of  Model  11  are  contained  in 
Table  19.  Reduced  model: 


Yfu  *  *0  *  X! 


or  in  logarithmic  form: 


Full  model 


L°g  (Y£u)  *  Log  (80)  ♦  8X  •  Log  (X^ 


Bl  B2 

Yfu  "  %  ‘  •  X2 


or  in  logarithmic  form: 

Log  (Yfu)  *  Log  (8  q)  ♦  B1  •  Log  (X1)  ♦  82  •  Log  (X2) 


where : 

Y £u  *  Unit  Index  portion  of  fabrication  direct  labor 
hours/equivalent  unit/accounting  month, 

X1  *  cumulative  output  plot  point  (cumulative  units 
at  end  of  accounting  month) , 

X2  *  production  rate/ accounting  month. 

Model  12.  The  results  of  Model  12  are  contained  in 
Table  20.  Reduced  model: 


y  *  8  •  X 

1  fsh  °0  *1 


or  in  logarithmic  form: 


Full  model: 


Log  (Yfsh)  "Log  (6  Q)  +  Sx  •  Log  (X^ 


B  i  3  f 

Yfsh  "  30  *  X1  *  X2  “ 


1 


TABLE  19 

Research  Hypothesis  One  Results 
Maverick  Model  11 


Unit  Index  for  Fabrication  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  g^ 

4.82 

6.82 

Estimated  g^ 

-0.10 

-0.07 

Estimated 

-- 

-0.11 

F  Ratio 

103.65 

114.45 

F  Critical  (2,  70) 

3.15 

Statistical  Hypothesis  1A 

Reject  Hg 

F  Statistic 

51.51 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

Reject  Hq 

Residual  Plot 

Acceptable 

KS  Statistic 

.13 

KS  Critical 

.16 

Durbin- Watson  Statistic 

1.80 

Durbin-Watson  Crit.  (d^/d^) 

1.55/1.67 

Criterion  Test  1A 

-- 

Passed 

R2  (Log) 

.  593 

.766 

R2  (Actual) 

.  662 

.773 

Criterion  Test  IB 

Passed 

Resid.  Analysis 

Mean  *  .011 

KS  Statistic  =»  .126  <  KSq  of  .160  Normal  Distrib. 
Constant  Variance  -  Yes 
Autocorr.  -  No 
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or  in  logarithmic  form: 


Log  (Yfsh)  *  Log  (80)  +  81  *  Log  (Xx)  +  S2  •  Log  (X2) 


where : 


fsh 


Standard  Hours  for  fabrication  direct  labor 
hours/equivalent  unit/accounting  month, 
cumulative  output ‘plot  point  (cumulative  units 
at  end  of  accounting  month), 
production  rate/accounting  month. 


Research  Hypothesis  One 
Analysis  Summary 

The  regression  analyses  and  hypotheses  testing  results 
for  Maverick  shown  in  Tables  13  through  20  indicate  support 
for  research  hypothesis  one.  The  eight  models  exhibited  a 
strong  inverse  relationship  between  the  dependent  variable  and 
the  independent  variables.  Each  model  supported  statistical 
hypothesis  one  (A)  with  ease.  The  results  of  testing  for 
statistical  hypothesis  one  (B)  in  every  model,  except  Models 
6  (assembly)  and  8  (Total  hours/missile)  ,  demonstrated  that 
the  explanatory  power  added  by  the  production  rate  variable 
was  statistically  significant  at  the  0.05  level  of  signifi¬ 
cance.  Only  Models  7,  9,  and  12  did  not  have  R“  (Actual) 
values  greater  than  0.75  under  criterion  test  one  (B) . 

Notwithstanding  these  excellent  results,  only  Models 
5  (fabrication) ,  10  (standard  hours  for  total  hours) ,  and  11 
(unit  index  for  fabrication)  were  found  appropriate  for  the 
Maverick  data.  Model  10  achieved  the  most  spectacular  results. 
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'ABLE  20 


Research  Hypothesis  One  Results 
Maverick  Model  12 

Standard  Hours  for  Fabrication  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Estimated  8g 

26. 25 

21.00 

Estimated  8^ 

-0.03 

-0.05 

Estimated  3^ 

-- 

0.07 

F  Ratio 

2.58 

32.23 

F  Critical  (2,  70) 

3.15 

Statistical  Hypothesis  1A 

'  * 

Reject  HQ 

F  Statistic 

35.43 

F  Critical  (1,  70) 

4.00 

Statistical  Hypothesis  IB 

Reject  Hg 

Residual  Plot 

Acceptable 

KS  Statistic 

.15 

KS  Critical 

.16 

Durbin-Watson  Statistic 

1.80 

Durbin-Watson  Crit.  (d  /dT ) 

u  L 

1.55/1.67 

Criterion  Test  1A 

-- 

Passed 

R2  (Log) 

.035 

.479 

R2  (Actual) 

.027 

.  46  3 

Criterion  Test  IB 

-- 

Failed 

Resid.  Analysis 

Mean  a  .065 

KS  Statistic  *  .15**  <  KSC  of  .160 
Constant  Variance  -  Marginal 
Autocorr.  -  Marginal 

Normal  Distrib. 

'8 


The  other  models  either  failed  the  KS  test  for  normality  of 
residuals,  the  Durbin-Watson  test  for  autocorrelation  of 
residuals,  the  constant  variance  test,  or  a  combination  of 
these  tests. 

In  summary,  the  results  supported  research  hypothesis 
one  for  the  Maverick  data.  All  eight  models  were  then  tested 
for  predictive  ability  under  research  hypothesis  two,  with 
statistical  inference  applying  only  to  appropriate  models 
(Models  5,  10,  and  11). 

Analysis  of  Research 
Hypothesis  Two* 

The  predictive  ability  analysis  of  the  Maverick  models 
(Models  5  through  12)  was  conducted  in  the  same  manner  as  des¬ 
cribed  for  the  SRAM  data.  The  73  data  points  in  the  Maverick 
data  permitted  a  more  realistic  simulation  scenario  than  for 
SRAM.  The  researchers  assumed,  for  purposes  of  simulation, 
that  the  Maverick  program  had  completed  43  months  of  produc¬ 
tion  and  wished  to  estimate  the  next  12  months'  direct  labor 
requirements.  Data  points  49  through  73  were,  therefore, 
truncated  and  regression  was  performed  on  points  1  through  48 
to  predict  the  hours  for  each  of  the  next  12  months  (points 
49  through  60) . 

Research  Hypothesis  Two 
.Analysis'  Summa~ry 

Tables  21  through  28  summarize  the  predictive  ability 
tests  conducted  for  Models  5  through  12  of  the  Maverick  data. 
Since  Models  5,  10,  and  11  were  the  only  ones  found  appr  :rr  :  .  • 
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TABLE  21 


Research  Hypothesis  Two  Results 
Maverick  Model  5 
Fabrication  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

2.26 

5.05 

Variance 

3.19 

6.61 

Z  Test  Statistic 

-- 

-15.41 

Z  Critical 

-- 

-1.65 

Statistical  Hypothesis  Two 

_  « 

Fail  to 

. 

Reject  HQ 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 
predictions  (within  5  percent) 

145 

48 

Total  number  of  good  predictions 
(within  10  percent) 

213 

94 

Criterion  Test  Two 

-- 

Failed 

for  the  data,  statistical  inferences  were  made  only  for  them. 
Model  10  (Standard  Hours  portion  of  total  hours)  exhibited 
the  best  results.  The  average  absolute  deviation  of  the  pre¬ 
dicted  values  from  the  actuals  for  the  full  model  was  about 
half  of  that  for  the  reduced  model.  The  full  model's  superior 
predictive  ability  was  found  to  be  statistically  significant 

80 


.-/■  '  - 


TABLE  22 


Research  Hypothesis  Two  Results 
Maverick  Model  6 
Assembly  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

5.98 

6.88 

Variance 

14.35 

50.73 

Z  Test  Statistic 

-- 

-1.93 

Z  Critical 

-- 

-1.65 

Statistical  Hypothesis  Two 

-- 

Fail  to 
Reject  Hq 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  5  percent) 

50 

79 

Total  number  of  good  predictions 
(within  10  percent) 

104 

128 

Criterion  Test  Two 

-- 

Failed 

at  the  0.05  level  of  significance.  It  was  also  found  to  be 
a  practical  predictor  with  192  out  of  300  test  situations 
falling  in  the  good  range  (within  10  percent).  Meanwhile, 
the  reduced  model  had  only  8  out  of  300  predictions  within 
10  percent  of  the  actuals.  Models  5  and  11  both  found  the 
better  predictor  to  be  the  reduced  model  in  terms  of 
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TABLE  23 


Research  Hypothesis  Two  Results 
Maverick  Model  7 
Test  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

8.92 

7.38 

Variance 

41.46 

37.16 

Z  Test  Statistic 

-- 

2.99 

Z  Critical 

-- 

1.65 

Statistical  Hypothesis  Two 

-- 

Reject  Hq 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  5  percent) 

99 

119 

Total  number  of  good  predictions 
(within  10  percent) 

143 

200 

Criterion  Test  Two 

-- 

Passed 

statistical  significance.  However,  both  the  reduced  and  full 
models  generally  did  not  prove  very  practical,  with  few  pre¬ 
dictions  in  the  "good"  range.  The  reduced  form  under  Model 
5  was  the  exception,  getting  half  of  the  predictions  in  the 
"excellent"  range  and  two- thirds  in  the  "good"  range  overall. 

Several  observations  are  warranted  for  the  models  not 


TABLE  24 


Research  Hypothesis  Two  Results 
Maverick  Model  8 
Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

8.92 

7.38 

Variance 

41.46 

37.16 

Z  Test  Statistic 

-- 

2.99 

Z  Critical 

-- 

1.6S 

Statistical  Hypothesis  Two 

-- 

Reject  HQ  • 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  S  percent) 

99 

119 

Total  number  of  good  predictions 
(within  10  percent) 

143 

200 

Criterion  Test  Two 

-- 

Passed 

deemed  appropriate  under  research  hypothesis  one  (Models  6-9 
and  12) .  These  observations  are  presented  with  caution  since 
statistical  inferences  cannot  be  made  with  inappropriate 
models.  However,  a  model  may  be  statistically  inappropriate 
but  prove  to  be  a  good  predictor  from  a  practical  standpoint. 
This  was  the  case  for  Models  7  (test  hours)  and  8  (total  hours) 
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TABLE  25 


Research  Hypothesis  Two  Results 
Maverick  Model  9 

Unit  Index  for  Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

0.60 

1.01 

Variance 

0.18 

0.32 

Z  Test  Statistic 

-- 

-9.94 

Z  Critical 

-- 

-1.65 

Statistical  Hypothesis  Two 

-- 

Fail  to 
Reject  Hg 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  5  percent) 

77 

26 

Total  number  of  good  predictions 
(within  10  percent) 

171 

64 

Criterion  Test  Two 

-- 

Failed 

The  full  form  of  both  models  had  119  out  of  300  predictions 
in  the  "excellent”  range  and  200  in  the  "good"  range  overall. 
Six  of  the  eight  models  consistently  demonstrated  the  full 
model  to  have  the  better,  and  more  practical,  predictive 
ability.  Consequently,  one  could  not  refute  the  better  pre¬ 
dictive  ability  of  the  full  model  from  a  "real  world," 


TABLE  26 


Research  Hypothesis  Two  Results 
Maverick  Model  10 

Standard  Hours  for  Total  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

6.86 

3.98 

Variance 

1.42 

2.01 

Z  Test  Statistic 

-- 

26.91 

Z  Critical 

-- 

1.65 

Statistical  Hypothesis  Two 

Reject  Hq 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  5  percent) 

0 

37 

Total  number  of  good  predictions 
(within  10  percent) 

8 

192 

Criterion  Test  Two 

-- 

Passed 

practical  standpoint. 

In  summary,  because  of  the  superior  results  achieved 
by  the  full  form  of  the  model  for  the  appropriate  models  (5, 
10,  and  11)  and  the  better  practical  predictive  ability  ex¬ 
hibited  by  the  full  form  for  the  remaining  inappropriate 
models,  research  hypothesis  two  was  considered  supported  for 


TABLE  27 


Research  Hypothesis  Two  Results 
Maverick  Model  11 

Unit  Index  for  Fabrication  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

0.28 

0.34 

Variance 

0.02 

0.03 

Z  Test  Statistic 

-- 

-4.76 

Z  Critical 

-- 

-1.6S 

Statistical  Hypothesis  Two 

-- 

Fail  to 
Reject  Hq 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  S  percent) 

3 

5 

Total  number  of  good 

predictions  (within  10  percent) 

83 

S3 

Criterion  Test  Two 

-- 

Failed 

the  Maverick  data. 

Comparative  Analysis  and  Summary 

The  results  of  regression  analysis  on  the  twelve  models 
tested  revealed  marked  similarities  and  differences  between 
the  SRAM  and  Maverick  data.  The  common  and  unique  features  of 
each  program  are  discussed.  A  summary  of  the  research  finding 


TABLE  28 


..  Research  Hypothesis  Two  Results 
Maverick  Model  12 

Standard  Hours  for  Fabrication  Hours  Per  Unit 


Test  Items 

Reduced 

Model 

Full 

Model 

Average  absolute  deviation 

2.81 

S.  55 

Variance 

0.42 

17.77 

Z  Test  Statistic 

-- 

-11.12 

Z  Critical 

-- 

-1.6S 

Statistical  Hypothesis  Two 

Fail  to 
Reject  HQ 

Total  number  of  test  situations 

300 

300 

Total  number  of  excellent 

predictions  (within  5  percent 

0 

68 

Total  number  of  good  predictions 
(within  10  percent) 

31 

108 

Criterion  Test  Two 

-- 

Passed 

and  evaluation  of  the  applicability  of  the  production  rate 
model  to  the  data  sets  complete  Chapter  IV. 

Comparative  Analysis 

The  Maverick  and  SRAM  production  data  exhibited  several 
common  characteristics.  Both  data  sets  covered  the  entire 
production  history  for  their  respective  programs,  from 


commencement  of  full-scale  production  to  complete  or  near- 
complete  phase-down.  Both  were  long-running  programs;  42 
months  for  SRAM  and  73  months  for  Maverick.  Both  production 
programs  occurred  during  basically  the  same  time  frame,  the 
mid-1970s.  As  a  result,  they  both  utilized  the  production 
technology  and  processes  prevalent  in  the  industry  at  that 
time.  Finally,  a  most  fortunate  common  feature  was  meeting 
the  basic  assumptions  of  learning  curve  models.  Neither 
program  experienced  any  significant  changes  in  production 
technology,  missile  design,  or  accounting  procedures. 

While  the  similarities  between  the  two  programs  en¬ 
hanced  the  researchers'  ability  to  apply  the  findings  to 
missile  production  programs  in  general,  the  differences  added 
depth  to  the  analysis.  One  of  the  primary  factors  affecting 
the  outcome  of  the  analysis  was  the  labor/capital  mix  of  the 
programs.  The  SRAM  data  reflected  production  operations  at 
the  Boeing  plant,  which  consisted  of  minor  and  major  assembly 
with  very  little  fabrication.  Hence,  the  SRAM  program  was 
a  labor-intensive  effort.-  Conversely,  the  Maverick  program 
was  characterized  by  capital-intensive  operations;  i.e.  much 
fabrication  performed  in-house  along  with  assembly  and  test. 
As  a  result,  the  SRAM  program  exhibited  generally  steeper 
slopes  for  che  model  coefficients. 

Two  other  differing  aspects  of  the  programs  were  the 
production  quantities  and  variation  in  production  rate.  SRAM 
production  was  for  1,500  units  while  Maverick  was  for  about 
26,500.  One  would  expect  mass  production  techniques  to  apply 
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to  Maverick,  with  SRAM  more  toward  the  batch  production  metho- 

,  dology  end  of  the  spectrum.  The  production  rate  requirement 

•  / 

for  SRAM  was  40  units  per  month  throughout  the  program. 

Although  plant  actuals  varied  from  this  goal,  a  40-unit 
delivery  rate  was  maintained  for  the  bulk  of  the  program.  In 
contrast,  the  Maverick  program  exhibited  a  much  less  stable 
production  rate  throughout  the  program.  Because  the  SRAM 
program  had  a  more  stable  production  rate,  one  would  expect 
the  contribution  of  the  production  rate  variable  to  the  explana 
tory  ability  of  the  model  to  be  less  for  SRAM  than  Maverick. 

The  analysis  supported  this  intuitive  notion  and  will' be  dis¬ 
cussed  in  detail  later. 

Summary 

The  preceding  analyses  of  the  two  missile  production 
programs  were  based  on  the  methodology  and  data  treatment  as 
described  in  Chapter  III.  As  shown  in  Table  29,  five  out  of 
the  twelve  models  tested  were  found  appropriate  for  the  data. 
Models  1  and  3  for  SRAM  and  5,  10,  and  11  for  Maverick.  Of 
those  five,  only  three  (all  Maverick  models)  supported  re¬ 
search  hypothesis  one.  The  contribution  of  the  production 
rate  variable  to  the  explanatory  ability  of  the  model  was 
difficult  to  assess  for  the  SRAM  data  because  of  the  already 
strong  relationship  between  the  cumulative  output  variable 
and  the  direct  labor  variable.  With  R^  (actual)  values  for 
the  reduced  model  already  in  the  high  .90s,  there  was  little 
room  for  improvement  in  spite  of  the  good  R  (actual)  values 
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TABLE  29 


Change  In  R2  (Actual)  For  All  Twelve  Models 
Tested  After  Inclusion  of  Production  Rate 


Model 

R2 

Reduced 

R2 

Full 

AR2 

1  (Fab/Assy)* 

.928 

.927 

-.001 

2  (Maj.Assy) 

.996 

.996 

.000 

3  (Total/Act.)* 

.975 

.975 

.000 

4  (Total/Deliv) 

.938 

.944 

.006 

5  (Fab.)* 

.797 

.807 

.010 

6  (Assy.) 

.837 

.811 

-  .026 

7  (Test) 

.551 

.500 

-.051 

8  (Total) 

.850 

.846 

-  .004 

9  (Unit  Index  Tot) 

.752 

.705 

-.047 

10  (Std. Hr. Total)* 

.752 

.912 

.160 

11  (Unit  Index  Fab) 

*  .662 

.773 

.111 

12  (Std. Hr.  Fab) 

.027 

.463 

.436 

*These  models  were 
others  were  found 

found  appropriate 
inappropriate. 

for  the 

data.  All 

for  the  production  rate  variable  alone  (.70s  and  .80s).  In 
contrast,  the  models  for  the  Maverick  data  revealed  that  the 

production  rate  variable  was  an  important  explainer  of  vari- 

2 

ation  in  direct  labor  requirements.  R  (actual)  increased 
1  percent  for  Model  5,  16  percent  for  Model  10,  and  11  percent 
for  Model  11.  Other  models  showed  slight  decreases  in 
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(actual)  values  while  Model  12  attained  a  spectacular  in¬ 
crease  of  44  percent;  however,  statistical  inferences  could 
not  be  made  with  confidence  with  these  models  because  they  did 
not  pass  the  appropriateness  tests. 

Research  hypothesis  two  was  not  accepted  for  the  SRAM 
data,  but  was  accepted  for  the  Maverick  data.  The  simulation 
showed  that  the  appropriate  SRAM  models  (1  and  3)  were  excel¬ 
lent  predictors  over  the  selected  range  of  data  points,  but 
there  was  no  statistical  difference  between  the  strength  of 
the  reduced  and  the  full  forms  of  the  model.  The  appropriate 
Maverick  models  (5,  10,  and  11)  were  shown  to  have  varying 
predictive  abilities.  The  full  form  of  Model  10  clearly 
demonstrated  superior  predictive  capability,  both  statistically 
and  practically.  On  the  other  hand.  Model  5  revealed  the 
reduced  model  to  be  better,  while  Model  11  produced  inconclu¬ 
sive  results.  The  other  Maverick  models,  though  not  appro¬ 
priate  for  the  data,  showed  the  better  predictor  to  be  the 
full  model  from  a  practical  standpoint  in  almost  every  case. 

In  summary,  the  support  for  research  hypothesis  two  was  not 
overwhelming,  but  significant  enough  to  be  accepted  without 
reservation. 

A  major  fin’ing  of  the  analysis  was  the  smoothing  effect 
the  addition  of  the  production  rate  variable  had  on  autocorre¬ 
lation  of  the  residuals.  A  Durbin-Watson  statistic  was  com¬ 
puted  for  the  reduced  model,  full  model,  and  "production  rate 
variable  alone"  form  of  the  reduced  model.  Larger  values  of  the 
statistic  indicated  less  autocorrelation,  and  vice-versa. 
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As  shown  in  Table  30,  the  reduced  form  of  all  twelve  models 
has  unacceptable  or  indecisive  autocorrelation.  The  addition 
of  the  production  rate  variable  in  the  full  model  significantly 
reduced  this  severe  autocorrelation  problem,  increasing  the 
number  of  appropriate  models  from  zero  to  three  and  raising 
two  others  into  at  least  the  marginal  range.  The  strong 
residual  smoothing  effect  of  the  production  rate  variable  was 
clear.  When  it  was  substituted  for  the  cumulative  output 
variable  in  the  reduced  form  of  the  model,  almost  all  auto¬ 
correlation  disappeared,  increasing  the  number  of  appropriate 
models  from  zero  to  nine  out  of  twelve.  The  decrease  in  auto¬ 
correlation  problems  for  the  full  model  was  attributed  to 
this  phenomenon. 

An  intriguing  discovery  by  the  researchers  may  explain 
why  this  phenomenon  occurred.  A  widely  used  method  for  de¬ 
creasing  autocorrelation  is  the  "method  of  first  differences" 
(11:649) .  The  procedure  entails  taking  the  "first  differences" 
of  all  variables  in  the  model.  In  other  words,  for  a  column 
of  data  listed  in  time  series,  subtract  the  first  number  in 
the  column  from  the  second  number  in  the  column  to  compute  a 
new  "first  difference"  value.  Then  proceed  down  the  column 
to  obtain  a  new  column  of  "first  difference"  transformed  num¬ 
bers.  This  is  exactly  the  way  the  production  rate  variable 
is  calculated.  The  production  rate  is  the  "first  difference" 
of  the  cumulative  output.  For  example,  if  the  number  of  units 
produced  the  first  month  is  50,  the  cumulative  output  is  50 
and  the  production  rate  is  50.  If  60  more  units  are  produced 
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TABLE  30 


Durbin-Watson  Statistics 


Model 

Reduced 

Model 

PRODRATE 
Variable  Alone 

Full 

Model 

1 

1.30** 

3.11*** 

1.51** 

2 

1.07* 

2.80*** 

1.14* 

3 

1.09* 

3.22*** 

1.35** 

4 

.43* 

1.07* 

.51* 

5 

1.34* 

2.18*** 

1.91*** 

6 

.86* 

2 . 24*** 

.79* 

7 

.93* 

.80* 

.81* 

8 

.61* 

.76* 

.63* 

9 

.69* 

.56* 

.59* 

10 

.23* 

1.70*** 

1.66*** 

11 

.81* 

2.15*** 

1.80*** 

12 

.49* 

2.01*** 

1.08* 

•Autocorrelation  present;  statistic  less  than  cL  table 
values.  L 

••Indecisive;  statistic  between  d,  and  d  table  values. 
•••Neither  autocorrelated  nor  indecisive .statistic  greater 
than  du  table  values. 

the  second  month, 

then  the 

cumulative  output  is 

110 

and  the 

production  rate  for  that  month  is  60.  The  "first  difference" 
for  the  second  month  would  be  110  minus  50,  or  60  units.  Since 
the  production  rate  is  the  "first  difference"  of  the  cumula¬ 
tive  output,  this  may  very  well  explain  why  the  addition  of 
the  production  rate  to  the  model  significantly  reduced  the 
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severe  autocorrelation  problems  with  the  reduced  form  of  the 
model. 


Another  observation  concerned  the  sensitivity  of  the 
regression  coefficients,  as  summarized  in  Table  31.  For  all 
twelve  models  tested  the  mean  change  in  gg  from  the  reduced 
to  the  full  model  was  about  12  percent  with  a  10  percent  stan 
dard  deviation.  The  g^^  coefficients  reflected  even  more  vari 
ability  with  a  mean  change  of  about  18  percent  and  standard 
deviation  of  20  percent.  These  results  indicated  that  even 
within  a  particular  program,  the  coefficients  were  sensitive. 
This  sensitivity  suggests  that  development  of  general  cost 
models  using  coefficients  derived  from  several  missile  produc 
tion  programs  is  inappropriate. 

An  interesting  sidelight  of  the  research  was  the  par¬ 
titioning  of  the  Maverick  direct  labor  data  into  two  compon¬ 
ents,  the  Unit  Index  (labor  improvement)  and  Standard  Hours 
(methods  improvement).  Tables  29  and  30,  shown  earlier,  do 
not  indicate  any  significant  trends  or  differences  for  the 
two  categories  in  the  respective  models  (9  through  12) . 

Table  31  does  point  out  a  pattern  in  the  slope  of  the  coeffi¬ 
cients.  The  Unit  Index  coefficients  (Models  9  and  11)  con¬ 
sistently  demonstrated  much  steeper  slopes  than  the  Standard 
Hours (Models  10  and  12) .  This  indicated  that  more  of  the 
learning  improvement  was  due  to  labor  learning  than  methods 
improvement. 

The  analysis  of  the  SRAM  and  Maverick  production  pro¬ 
grams  thus  met  the  objectives  of  the  research  in  determining 
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TABLE  31 

Model  Coefficient  Variability 


Model 

eo 

Reduced 

eo 

Full 

m 

S1 

Reduced 

S1 

Full 

8 

2 

1 

1775 

1882 

6 

-.20 

-.19 

-5 

-.04 

2 

1863 

1890 

1.4 

-.39 

-.39 

0 

-.01 

3 

3367 

3521 

4.6 

-.26 

-.25 

-3.8 

-.03 

4 

3185 

3615 

13.5 

-.25 

-.24 

-4 

-.06 

5 

126 

143 

13.4 

-.13 

-.12 

-7.7 

-.04 

6 

902 

998 

10.6 

-.30 

-.28 

-6.6 

-.05 

7 

151 

170 

12.6 

-.27 

-.22 

-18.5 

-.11 

8 

735 

740 

.5 

-.21 

-.21 

0 

-.01 

9 

37 

41 

10.8 

-.19 

-.13 

-31.6 

-.10 

10 

79 

72 

-8.9 

-  .05 

-.09 

44.4 

.08 

11 

4.8 

6.8 

41.7 

-.10 

-.07 

-30.0 

-.11 

12 

26 

21 

-19.2 

-.03 

-.05 

66.6 

.07 

Mean 

68- 

11.93 

18.18 

Std. 

Dev.  - 

10.36 

20.08 

the  effect  of  production  rate  variation  on  direct  labor  require¬ 
ments  for  missile  production  as  well  as  evaluating  the  predic¬ 
tive  ability  of  the  cumulative  production  and  production  rate 
model.  Of  the  two  programs  analyzed,  only  the  Maverick  program 
passed  all  tests. 
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CHAPTER  V 

SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 

Air  Force  managers  attempting  to  plan  the  acquisition, 
operation,  and  maintenance  of  major  weapon  systems  face  an 
increasing  array  of  obstacles.  Inflation,  spiraling  cost  of 
energy,  questionable  availability  of  energy,  increased  foreign 
competition,  and  international  political  instability  have 
created  a  great  deal  of  uncertainty.  While  the  task  has  per¬ 
haps  never  been  more  difficult  than  now,  the  need  for  accurate 
cost  estimating  is  obvious.  Without  accurate  cost  predictions, 
effective  budgeting  is  severely  hampered. 

One  of  the  most  significant  cost  elements  in  a  major 
system  acquisition  is  direct  labor.  Experience  has  shown 
that  direct  labor  costs  are  most  often  estimated  using  learn¬ 
ing  curve  techniques . 


Summary 

Literature  Review 

Learning  curve  models  were  in  use  as  early  as  the  1920s. 
Widespread  interest  was  generated  as  a  result  of  the  aerospace 
industry's  experience  during  World  War  II.  Since  then,  numer¬ 
ous  variations  of  the  basic  learning  curve  model  have  been 
investigated.  With  budgetary  and  political  controls  causing 
program  accelerations  and  decelerations,  the  variation  that 
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has  much  promise  for  00D  application  is  the  model  that  con' 
siders  the  effect  of  production  rate  variations. 


As  Chapter  II  indicated,  most  of  the  research  on  the 
effect  of  production  rate  changes  concluded  that  production 
rate  is  a  significant  determinant  of  direct  labor  costs. 
Several  years  ago.  Smith  developed  a  learning  curve  model 
that  included  a  production  rate  variable.  The  model  was 
tested  on  00D  airframe  programs  and  yielded  promising  results 
Since  then.  Smith's  model  has  been  applied  to  other  airframe 
programs,  avionics,  engines,  and  has  now  been  extended  to  air 
launched  missiles. 

The  Model 

The  production  rate  model,  which  Smith  called  the  full 
model,  is  presented  as  follows: 

81  S2 

Y  *  B0  *  X1  *  X2  *  10 

where  the  variables,  in  general  terms,  are  described  as 
follows : 

Y  represents  direct  labor  hours, 
represents  cumulative  output, 

X2  represents  the  production  rate, 
e  represents  the  variation  which  remains  unexplained 
by  the  variables  in  the  model,  and 
80,81,82  are  resression  coefficients. 

To  facilitate  regression  analysis,  the  model  is  linearized 
using  logarithms  as  follows: 
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Log  Y  ■  Log  8q  +  Log  X1  ♦  S2  Log  X2  ♦  e 

The  reduced  model  referred  to  in  this  research  is  simply  the 
basic  learning  curve  model.  It  is  identical  to  the  full  model, 
before  and  after  logarithmic  transformation,  except  that  the 
reduced  model  does  not  include  the  production  rate  variable 
(6:89) . 

Research  Objectives 

As  stated  in  Chapter  I,  the  three  objectives  of  this 
research  were:  1)  to  determine  how  changes  in  the  production 
rate  affect  total  direct  labor  hour  requirements  per  missile, 

2)  to  determine  how  the  full  model  compares  with  the  reduced 
model  as  a  predictor  of  direct  labor  hour  requirements  for 
continuing  missile  production,  and  3)  to  determine  if  Smith's 
model  is  applicable  to  missile  production. 

Methodology 

Linear  regression  analysis  of  the  logarithmic  forms  of 
the  full  and  reduced  models  was  employed  to  achieve  the  re¬ 
search  objectives.  Data  were  obtained  from  two  missile  pro¬ 
duction  programs,  SRAM  and  Maverick.  As  in  previous  research, 
the  data  from  each  program  required  individual  treatment.  Data 
treatment  is  described  in  Chapter  III.  Twelve  specific  models 
were  developed  and  then  statistically  analyzed  under  the  re¬ 
search  hypotheses. 

Research  hypothesis  one  stated  that  the  production  rate 
explains  a  significant  amount  of  the  variation  in  direct  labor 
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requirements  for  missile  production.  Two  statistical  tests 
and  two  criterion  tests  were  employed  respectively.  The  first 
statistical  test  was  an  F-test  to  determine  if  a  relationship 
existed  between  the  dependent  variable  (labor  hours)  and  the 
independent  variables  (cumulative  output  and  production  rate). 
The  second  statistical  test  was  another  F-test  to  determine 
the  production  rate  variable's  ability,  when  combined  with  the 
cumulative  output  variable,  to  explain  additional  variation  in 
the  dependent  variable. 

The  first  criterion  test  then  evaluated  the  error  terms 
in  the  model  for  constant  variance,  independence,  and  normal 
distribution.  The  second  criterion  test  required  R2  (actual) 
to  be  greater  than  or  equal  to  .75,  an  arbitrary  measure  of 
the  model's  ability  to  explain  a  sufficient  amount  of  varia¬ 
tion  in  the  dependent  variable  (6:91).  Any  model  that  passed 
both  statistical  and  both  criterion  tests  was  considered 
appropriate  for  further  testing  under  research  hypothesis  two. 

Research  hypothesis  two  stated  that  the  production  rate 
model  predicts  direct  labor  requirements  better  than  the  basic 
learning  curve  model.  One  statistical  test  and  one  criterion 
test  were  used  to  evaluate  this  hypothesis.  A  stepwise  trun¬ 
cation  procedure  was  employed  to  simulate  the  model's  ability 
to  predict  direct  labor  requirements  for  the  next  12  months. 
The  last  12  data  points  (months)  were  omitted  and  then  pre¬ 
dicted  using  the  simulation  procedure.  The  statistical  test 
consisted  of  a  t-test  or  a  Z-test  to  determine  if  the  average 
absolute  deviation  of  the  full  model  was  significantly  less 


than  that  of  the  reduced  model  over  the  12-month  interval.  The 
criterion  test  compared  predicted  values  to  the  actual  observed 
values  and  classified  the  deviations  into  categories.  Thus, 
a  practical  measure  of  the  amount  of  deviation  in  both  the 
full  and  reduced  models  was  achieved. 

Research  objective  three  (determine  if  Smith's  model 
applies  to  missiles)  was  subjectively  evaluated  using  the 
results  of  the  hypothesis  testing  for  all  12  models  developed 
from  the  data. 


Conclusions 

The  three  primary  conclusions  of  this  research  relate 
directly  to  the  research  objectives.  First,  the  production 
rate  was  found  to  explain  a  significant  amount  of  variation 
in  direct  labor  hours  in  nine  of  the  twelve  models  examined. 

Of  these  nine,  only  five  cases  were  found  appropriate  for  the 
data.  Three  of  the  twelve  cases  passed  all  tests  in  support 
of  research  hypothesis  one.  While  not  all  cases  supported 
the  first  research  objective,  enough  support  was  evident  to 
conclude  that  the  production  rate  variable  should  be  con¬ 
sidered  when  evaluating  missile  production  programs. 

Second,  the  results  of  the  predictive  ability  compari¬ 
son  were  mixed.  The  predictive  ability  of  the  full  model  was 
excellent  for  all  four  SRAM  cases.  However,  the  predictive 
ability  of  the  reduced  model  was  approximately  equal  because 
of  the  overwhelming  effect  of  the  cumulative  output  variable 
in  the  SRAM  program.  Five  of  the  eight  Maverick  cases  clearly 
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showed  that  the  full  model  predicted  direct  labor  require¬ 
ments  better  than  the  reduced  model.  Of  the  three  Maverick 
cases  that  were  statistically  appropriate  under  research 
hypothesis  one,  one  case  showed  superior  results  for  the  full 
model,  one  case  showed  the  reduced  model  to  be  a  better  pre¬ 
dictor,  and  one  case  was  inconclusive.  Results  for  the 
second  research  objective  indicate  that  the  superiority  of 
the  full  model  for  prediction  depends  on  the  particular  pro¬ 
gram  and  circumstances.  The  beauty  of  Smith's  model  is  that 
the  user  is  given  an  indication  of  how  well  the  model  is  likely 
to  predict  in  a  given  situation  without  having  to  actually  wait 
a  year  to  determine  the  outcome. 

Third,  as  a  result  of  the  hypothesis  testing,  the  authors 
have  concluded  that  Smith's  model  has  widespread  potential  for 
missile  production  programs  and  merits  additional  study.  Fur¬ 
ther,  this  research  represents  the  fifth  application  of  Smith's 
model  to  various  aspects  of  DOD  aerospace  programs.  All  five 
research  efforts  have  yielded  positive  results  in  at  least 
part  of  the  programs  selected  for  study.  Table  32  summarizes 
the  general  areas  that  have  been  investigated,  and  shows  the 
average  increase  in  the  amount  of  direct  labor  variation 
explained  by  using  the  full  model.  In  every  case,  additional 
variation  has  been  explained  (the  average  increase  in  explained 
variation  over  all  five  studies  was  11.3  percent). 

An  11  percent  improvement  in  the  accuracy  of  labor 
estimates  could  result  in  substantial  savings  on  large-dollar 
programs.  An  added  benefit  could  be  enhanced  credibility  for 
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TABLE  32 

2 

Mean  (Average)  Changes  in  R  (Actual)  For 
All  Research  Programs  Using 
Smith's  Production  Rate  Model 


Area 

of  Researchers 

Application 

Average 
r2  Actual 
Reduced 

Average 
r2  Actual 
Full 

Average 

AR2 

Airframes 

Smith 

•  .818 

.916 

.098 

Airframes 

Congleton/Kinton 

.912 

.953 

.041 

Avionics 

Stevens /Thomerson 

.491 

.  773 

.282 

Engines 

Crozier/McGann 

.402 

.496 

.094 

Missiles 

Allen/Farr 

.755 

.805 

.050 

DOD  personnel  who  must  present  budgetary  requirements  to  Con¬ 
gress.  In  any  event,  these  initial  successes  justify  the 
application  of  Smith's  model  to  other  systems  and  subsystems 
in  the  aerospace  industry.  Three  additional  conclusions 
resulted  from  this  research  and  are  discussed  next. 

Additional  Conclusions 

As  in  all  previous  research,  the  regression  coefficients 
developed  through  regression  analysis  for  a  particular  data 
set  were  unique  to  that  data  set.  The  coefficients  are  sensi¬ 
tive  to  almost  any  kind  of  change  in  a  program,  even  from 
month  to  month  within  the  same  program.  Therefore,  a  general 
model  cannot  be  developed  that  applies  to  all  missile  produc¬ 
tion  programs. 
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As  described  in  Chapter  IV,  the  addition  of  the 
production  rate  variable  tended  to  smooth  any  autocorrelation 
that  was  present  in  the  data.  This  phenomenon  occurs  because 
the  production  rate  is  in  effect  the  "first  difference"  of 
the  cumulative  output.  This  smoothing  effect  adds  a  distinct 
advantage  to  the  full  model. 

Finally,  several  of  the  cases  studied  during  this  re¬ 
search  yielded  models  that  were  statistically  inappropriate 
for  the  data.  Whenever  a  user  encounters  this  predicament, 
alternative  methods  of  estimating  should  not  be  forgotten. 
Exponential  smoothing,  moving  averages,  and  trend  analysis 
are  examples  of  estimating  techniques  that  can  be  performed 
easily  with  a  hand  calculator. 

Recommendations 

The  production  rate  model  is  available  to  users  in  the 
Copper  Impact  Library  under  the  file  name  PRODRATE.  With  the 
model  available  and  substantial  success  in  five  research 
efforts,  the  Air  Force  should  emphasize  use  of  the  model  on 
actual  production  programs.  The  model  has  potential  applica¬ 
tion  anywhere  that  learning  curve  theory  applies. 

A  related  recommendation  is  that  a  checklist  guide  to 
the  practical  use  of  the  model  be  developed.  Such  a  guide 
would  encourage  use  of  the  model  by  those  who  are  uneasy  with 
statistics  and  the  seeming  complexity  of  the  model. 

Finally,  further  research  efforts  are  recommended  for 
other  major  aerospace  systems  and  subsystems.  For  instance, 
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this  research  investigated  air-launched  missiles  built  with 
the  early  1970 's  technology.  Other  applications  might  include 
ground-  and  sea- launched  missiles  as  well  as  other  air-launched 
missiles  produced  with  more  recent  technology. 


APPENDIX 

THE  COMPUTER  PROGRAM  PRODRATE 
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This  appendix  is  made  up  of  three  sections.  The  first 
section  describes  how  the  computer  program  PRODRATE  works  and 


the  improvements  made  by  the  authors.  The  second  section 
lists  the  revised  program  in  its  entirety.  Finally,  the 
third  section  presents  a  sample  run  of  simulated  test  data. 

The  PRODRATE  Program  and  the  Improvements 

Numerous  multiple  linear  regression  programs  containing 
a  wide  variety  of  options  were  available  for  this  research. 

As  in  the  previous  research  efforts  by  Smith  and  the  others 
that  followed  (reference  Chapter  II) ,  the  computer  program 
written  by  Smith  (15:147-153)  proved  to  be  the  best  tool  for 
accomplishing  the  research  objectives.  Most  regression  com¬ 
puter  programs  calculated  the  customary  R2  values,  coefficients, 
and  other  regression  statistics,  but  did  not  provide  an  assess¬ 
ment  of  model  predictability,  which  was  one  of  the  primary 
areas  of  interest.  PRODRATE  contained  a  user  option  that 
printed  a  listing  of  actual  direct  labor  requirements,  pre¬ 
dicted  direct  labor  requirements,  the  resulting  residuals, 
and  statistics  for  predictability  comparisons.  This  feature 
was  unique  and  was  one  the  authors  found  unavailable  elsewhere. 

Notwithstanding  the  desirable  characteristics  of 
PRODRATE,  it  did  have  several  undesirable  ones.  Stevens  and 
Thomerson  modified  the  program  extensively  (16:109-142)  to 
make  it  more  usable  for  cost  analysts  using  the  COPPER  IMPACT 
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computer  system.^  Their  improvements  greatly  enhanced  the 
program's  overall  usability,  but  left  several  serious  draw¬ 
backs  unchanged.  Residual  analysis  for  model  appropriateness 
is  essential  for  multiple  linear  regression  analysis.  The 
revised  version  of  PRODRATE  had  no  such  analysis  capability, 
forcing  the  user  to  rely  on  subjective,  manual  analysis  or 
computer  programs  on  other  systems.  As  a  result,  much  addi¬ 
tional  time  and  effort  had  to  be  expended  doing  manual  plots 
or  duplicating  data  bases  for  use  on  other  computer  systems. 
Other  drawbacks  included  long,  more  expensive  running  time 
and  a  need  for  more  program  output  flexibility. 

Because  of  these  undesirable  features,  the  authors, 
with  the  assistance  of  Captain  Tom  Sandman  of  the  Continuing 
Education  Department  in  the  AFIT  School  of  Systems  and  Logis¬ 
tics,  modified  the  PRODRATE  program  to  add  residual  analysis 
statistics,  improve  running  time,  and  increase  program 
usability.  These  changes  definitely  saved  considerable  time 
and  effort  in  conducting  the  research  and  will,  hopefully, 
do  the  same  for  future  PRODRATE  users. 

Before  the  specific  program  improvements  can  be 
addressed,  a  description  of  what  the  program  does  is  in  order 
Stevens  and  Thomerson  described  how  PRODRATE  works  in  the 
following  manner: 


COPPER  IMPACT  is  the  project  name  of  an  Air  Force  pro 
gram  to  Improve  Modern  Pricing  And  Costing  Techniques  in  the 
contracting  process.  TKe  time- sharing  computer  system  is 
designated  by  the  same  name,  COPPER  IMPACT,  and  is  currently 
government- leased  from  General  Electric. 
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The  program  reads  the  input  data  from  any  file 
specified  by  the  user.  Instructions  on  how  to  build  a 
data  file  are  available  in  the  program.  This  feature 
allows  the  user  to  change  the  form  of  the  model  (e.g., 
unit  curve,  cumulative  curve,  total  cost  curve)  simply  by 
making  the  necessary  modifications  to  the  data  base.  In 
addition,  an  option  within  the  program  allows  the  user  to 
list  the  input  data  as  they  were  read  from  the  data  file 
and  converted  to  logarithms. 

Analysis  of  the  data  is  begun  by  calculating  and 
printing  the  Pearson  correlation  coefficients  of  the 
three  variables:  direct  labor  requirements,  cumulative 
production,  and  production  rate.  Log- linear  regression 
is  first  performed  between  the  direct  labor  requirements 
(dependent)  variable  and  the  cumulative  production 
(independent)  variable.  Finally  the  dependent  variable 
is  regressed  against  both  independent  variables  simul¬ 
taneously. 

In  presenting  the  results  of  each  of  these  three 
regressions,  the  program  prints  a  listing  of  the  actual 
direct  labor  requirements,  the  predicted  direct  labor 
requirements,  and  the  residuals.  This  feature  of 
PRODRATE  is  one  the  authors  found  unavailable  elsewhere. 
The  obvious  advantage  is  that  the  user  can  relate  the 
results  to  the  original  untransformed  variable  (rational 
numbers,  not  logarithms)  and  see  how  well  the  untrans¬ 
formed  data  fit  the  model. 

Following  the  listing  of  the  residuals,  summary 
statistics  are  printed  for  each  model.  They  include  the 
values  for  the  coefficients  (exponents),  standard  errors, 
F  ratios,  R2 ,  r2  (actual),  and  learning  factor.  Two 
selective  options  for  which  additional  printouts  are 
available  are  the  Predictive  Ability  Tests  and  the 
Projection  and  Sensitivity  Matrix.  For  a  quick- look 
analysis  of  several  different  models,  the  program  can 
be  preset  to  stop  after  three  regression  analyses  by 
not  selecting  the  additional  options. 

The  Predictive  Ability  Test  option  permits  the  user 
to  select  the  number  of  data  points  (cases)  to  be 
truncated  during  the  test  and  thus,  control  the  time 
span  over  which  the  test  is  conducted.  The  test  is  per¬ 
formed  using  nested  DO  loops  to  perform  a  stepwise 
truncation  of  the  data  points.  The  truncated  data  is 
then  predicted  using  the  regression  results  of  the  re¬ 
maining  data.  After  all  truncated  cases  have  been 
predicted  and  results  printed,  a  summary  table  is  printed. 
This  summary  table  contains  data  on  statistical  signifi¬ 
cance  and  permits  subjective  comparisons  of  the  accuracy 
of  predictions  made  by  the  full  and  reduced  models.  .  .  . 

The  Projection  and  Sensitivity  Matrix  option  of 
program  PRODRATE  provides  the  cost  and  price  analyst  with 
a  means  of  predicting  direct  labor  requirements  at  vary¬ 
ing  production  rates.  This  option  also  permits  the  user 
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to  see  the  sensitivity  of  the  direct  labor  requirements 
to  changes  in  production  rate  over  a  wide  range  of  cumu¬ 
lative  production.  The  last  observed  values  for  cumula¬ 
tive  production  and  the  production  rate  are  used  as  the 
starting  point  for  this  projection.  The  cumulative  pro¬ 
duction  variable  is  increased  by  increments  of  1  percent 
of  the  last  observed  value,  while  the  production  rate 
variable  begins  at  70  percent  of  the  last  observed  value 
and  is  increased  by  10  percent  increments  until  it  reaches 
ISO  percent  of  the  last  observed  value. 

These  projections  are  printed  in  matrix  form  with  the 
projected  production  rates  printed  across  the  top  of  the 
matrix  and  the  projected  cumulative  production  plot 
points  printed  along  the  left  margin  of  the  matrix. 
Projected  direct  labor  requirements  can  then  be  read 
directly  from  the  matrix  by  matching  a  given  production 
rate  with  a  given  number  of  cumulative  units.  The  value 
for  direct  labor  requirements  is  found  at  the  intersec¬ 
tion  of  the  corresponding  row  and  column. 

In  summary,  therefore,  the  program  PRODRATE  is  a 
modified  version  of  Smith's  FORTRAN  IV  program.  Like 
Smith's  program,  PRODRATE  converts  the  input  data  to 
logarithms  prior  to  regression.  In  addition,  PRODRATE 
permits  the  user  to  automatically  receive  or  decline 
either  or  both  of  the  options  for  Predictive  Ability 
Tests  and  Projection  and  Sensitivity  Matrices.  For  the 
analyst  who  is  accustomed  to  working  with  the  learning 
curve  model,  the  program  PRODRATE  quickly  shows  whether 
the  production  rate  variable  is  significant  and  the 
effect  it  has  on  estimating  direct  labor  requirements. 

The  authors  believe  the  program  PRODRATE  can  be  a  very 
useful  tool  for  the  government  cost  and  price  analyst 
[16:110-114] . 


Having  described  how  the  basic  PRODRATE  program  works, 
the  improvements  made  by  the  authors  can  now  be  addressed. 

As  mentioned  earlier,  the  modifications  were  made  to  accom¬ 
plish  three  objectives:  provide  statistics  to  determine 
appropriateness  of  the  regression  models,  reduce  expensive 
run-time,  and  increase  program  usability.  How  these  objectives 
were  accomplished  will  now  be  discussed. 

As  stated  in  Chapter  III,  each  regression  model  had  to 
satisfy  three  assumptions  to  be  deemed  appropriate  for  the 


data  and  valid  for  statistical  inference.  The  residuals  had 
to  be  normally  distributed,  have  a  constant  variance,  and  be 
statistically  independent.  The  PRODRATE  program  had  no  built 
in  tests  for  these  assumptions,  but  the  COPPER  IMPACT  system 
library  did.  The  library  contained  a  statistical  package 
called  STATU***,  which  possessed  the  necessary  residual  test 
ing  capability.  However,  PRODRATE  did  not  store  the  model 
residuals  for  analysis  by  other  computer  programs.  The 
authors  modified  PRODRATE  to  store  the  computed  residuals 
and  fitted  dependent  variable  values  for  each  model,  thus 
making  possible  the  use  of  the  powerful  STATU***  package. 

The  STATU***  package  contained  a  routine  called 
STAT1  that  computed  a  Kolmogorov- Smirnov  (KS)  statistic  for 
determining  if  a  population  was  normally  distributed.  The 
authors  ran  the  stored  residual  values  from  each  PRODRATE- 
generated  model  through  the  STAT1  routine  to  obtain  the  KS 
statistic  used  in  the  KS  test  for  normality  of  the  residuals. 

The  constant  variance  assumption  was  evaluated  using 
the  Plot  routine  under  STATU***.  Similar  to  the  methodology 
used  in  the  KS  test,  the  stored  residuals  were  plotted  (by 
the  computer)  versus  the  stored  fitted  dependent  variable 
values  for  each  model  run  through  PRODRATE.  The  authors  were 
then  able  to  ascertain  by  subjective  analysis  if  the  plot 
demonstrated  a  reasonably  constant,  random  variance  with  no 
noticeable  persistence. 

The  STATU***  system  also  contained  a  Durbin-Watson 
test  capability  for  independence  of  the  residuals.  However, 

110 


the  test  was  buried  in  an  expensive  multiple  regression 
routine.  Since  the  test  procedure  was  relatively  simple  to 
program,  the  authors  chose  to  modify  PRODRATE  to  compute  a 
Durbin-Watson  statistic  for  each  model.  This  approach 
avoided  the  need  for  costly  computer  time  under  STATU*** 
and  gave  PRODRATE  a  built-in  capability  to  test  for  autocor¬ 
relation  at  a  much  lower  cost. 

These  modifications  to  PRODRATE  to  store  computed 
residuals  with  fitted  dependent  variable  values  and  provide 
Durbin-Watson  statistics  greatly  facilitated  the  research. 

They  permitted  use  of  a  powerful  statistical  package  on  the 
same  computer  system  as  PRODRATE  and  provided  a  residual 
analysis  capability  in  PRODRATE  itself,  which  was  not  possible 
before.  These  improvements  eliminated  the  need  for  tedious 
manual  analysis  and/0T  time-consuming  transfer  of  raw  regres¬ 
sion  data  files  to  other  computer  systems. 

Several  PRODRATE  modifications  were  made  to  decrease 
run-time  and  increase  model  flexibility.  The  specific  changes 
included  transformation  of  the  program  from  FORTRAN  IV  into 
machine- readable  code,  addition  of  an  option  to  suppress  the 
full  printout,  and  an  option  for  more  detailed  specification 
of  truncation  parameters  in  the  short-range  prediction  routine. 
Each  of  these  refinements  will  be  discussed  separately. 

Because  the  basic  version  of  PRODRATE  was  stored  in  the 
COPPER  IMPACT  system  in  FORTRAN  IV  language  instead  of  machine 
language,  users  were  being  charged  for  compilation  each  time 
the  program  was  run.  They  also  had  a  short  waiting  period  for 
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program  execution  while  the  program  was  being  compiled.  By 
transforming  PRODRATE  into  a  machine-executable  form,  these 
unnecessary  charges  and  delays  were  eliminated. 

As  described  earlier,  PRODRATE  prints  the  observed, 
predicted,  and  residual  values  for  each  model  in  the  run.  It 
also  prints  a  detailed  series  of  matrices  under  the  short- 
range  prediction  option.  One  complete  run  of  PRODRATE  with 
this  printout  format  takes  about  35  minutes.  The  authors 
found  this  level  of  printout  detail  often  unnecessary. 
Therefore,  an  option  was  added  to  the  program  for  the  user  to 
elect  a  full  or  abbreviated  printout.  The  abbreviated  version 
eliminated  listing  of  observed,  predicted,  and  residual  values 
as  well  as  the  intervening  prediction  matrices.  When  the 
abbreviated  format  was  used,  the  run-time  was  reduced  from  35 
minutes  to  3  minutes.  Only  the  key  summary  tables  were  printed 
with  a  reduction  of  printouts  from  approximately  ten  pages  to 
one  page.  The  time  and  computer  cost  savings  are  obvious. 

The  last  section  of  this  appendix  shows  comparative  outputs 
of  the  full  and  abbreviated  formats. 

The  short-range  prediction  option  lacked  the  needed 
flexibility  for  the  prediction  simulation  used  in  the  research. 
As  described  in  Chapters  III  and  IV,  the  objective  was  to  simu¬ 
late  ’’real  world"  use  of  PRODRATE.  Many  users  are  a  number  of 
months  into  production  and  wish  to  forecast  direct  labor 
requirements  for  the  next  fiscal  year.  The  basic  version  of 
PRODRATE  allowed  simulation  only  at  the  end  of  the  production 
program  (where  "toe-up"  often  occurs),  and  had  no  capability 
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to  simulate  a  period  earlier  in  production.  As  a  result,  the 
authors  added  an  option  for  the  user  to  specify  the  simulated 
time  period  anywhere  in  the  last  half  of  the  production  pro¬ 
gram.  This  feature  added  the  needed  flexibility  to  meet  user 
needs . 

In  summary,  the  revised  version  of  PRODRATE  developed 
in  this  research  significantly  reduced  user  costs  and  program 
usability.  PRODRATE  users  can  now  perform  essential  residual 
analysis  with  the  additional  PRODRATE  statistics  and  the 
statistical  packages  already  in  the  COPPER  IMPACT  system.  In 
addition,  several  options  are  now  available  to  drastically 
decrease  run-time  and  increase  the  usability  of  the  predic¬ 
tion  routines . 

Listing  of  the  Revised  PRODRATE  Program 

This  section  lists  the  computer  program  PRODRATE  in 
its  entirety.  The  original  program  was  developed  by  Lt.  Col. 
Larry  L.  Smith,  and  later  modified  by  Capt.  David  Y.  Stevens. 
The  version  listed  incorporates  the  original  program  and  all 
modifications,  including  those  added  by  this  research.  The 
actual  program  used  during  this  research  is  the  program 
presented  in  this  section. 
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ms  ran*T(UW./MM<*»*l./Ml.NI.“PSORATE  tRSTAUUmS*./Ml.lMI*»1.//. 

um  *  ms  paocrm  is  oesicres  to  evkuate  the  vmuthm  i»  men  um  oewirererts  k  i  *./. 

tm  *  FURCTIW  OF  COPULATIVE  PMMUION  M  mOKTlM  RITE.  II  MIITIMh  IK  MMLTST  Ml  *./. 

ESN  *  COHPAK  IK  RESULTS  OITAISEI  HOT  T*  STAMMS  LEAMIRC  ONE  SITS  TK  RESULTS  OITAIKI  *./. 

mi  ■  ran  m  omutik  raonmn  m  pmrctim  mte  sokl.  the  cost  mils  uses  is  this  *./. 
mi  *  noon  ms*.//. 

sir  *  1.  asca  sMa  (STffnn  umsik  awe  son.]*.//. 

mi  ■  t  >  s  <  111  H  111  .  Ill  h  E !".//. 

m  ■  z.  rau.  me.  coussunK  pmscTin  m  ramenn  mte  hhbj*.//. 

mt  •  t  •  to  *  in  *•  m  •  in  m  k)  «  us  •«  ei *.//. 

mt  *  «ei  t  is  tk  men  um  kniiekhts*./. 

uh  •  u  n  tk  esmuTTK  raowenos  rot  ntsr./. 

jm  *  a  n  tk  raownm  mte  rani(c.c.  as  nr  mar  umts  ra  unto*./. 

3M  *  C  KPKSSH1S  TK  EM«  TEW./. 

mi  *  Mt  11.  MS  B  ME  PARAKTERS  OCTERRIAEI  IT  AECRERMr.//. 

MR  *  MT*  ME  IWT  IT  KM  IK  FIR  MT  PSQPERT  FORWTTO  MT*  FILE.  TOW  MT*  HIE  StMU  *./. 
AIR  *  K  sma  TO  MT  FEmwar  FILERME.  TOO  SIU  K  Ml  TO  [BUT  TK  MK  OF  TM*  MT*  FILE  *./• 

A2R  *  AT  TK  APPI0PI1ATE  STEP  IS  TK  FROCSM.  IK  MK  OF  TOW  MT*  FILE  CM  MT  EICEEB  I  *./. 

UM  *  CHARACTERS.  TK  FUST  UK  OF  TK  MT*  FOE  MIT  CSHTItl  *  UK  MKR  Ml  TK  HWOa  OF ’./• 
MM  *  OSES  TO  K  KM.  TK  OAT*  IS  IKS  ESTERS  OK  CME  FES  UK  IS  TK  F0U0SIK  OMEIi  V 
03R  '  UK  SUMS.  ORSERVEB  OIKCT  UM*  REW1I90T  IT).  COHOUTtK  PtOMCTION  PUT  FOIST  I1U.*./. 
UR  •  Mi  PMDOCTra  MTE  PM1T  112).  TK  FSOCRM  WQ  I  FOB  FIEU  KM  FMMT?  THERERSC.*./. 

(7H  *  EACH  INTAKE  OUST  K  SEPMATES  IT  IT  LEST  OK  SPACE  IN  OTHER  0EUKTER1  RT  M  OTHER*./. 

MR  *  SPECIAL  FORM!  IS  KOUIREI.  M  EUWLE  OF  I  MT*  FILE  KITH  S  CARS  IS  MESEHES  KLW*.//. 


MR  * 

w 

S *./. 

SSR  * 

isi 

US 

V.S 

VJ*./. 

SIR  * 

IK 

vs 

X 

UJTtlt 

sm  * 

in 

M 

SS 

ZP'h 

sm  * 

ISA 

71 

« 

ztv. 

SOM  * 

US 

71 

1U 

31*.//* 

SSR  *  OK  AKNMTAK  OF  ISIS  FROCRM  IS  TMT  TK  RESKTS  OTAIKI 101  K  a  TK  SAK  URTTS  AST./. 

SIM  *  FOR*  M  TK  1MPVT  MTA.  FOR  ETMPUi  IF  TOO  ME  HOAKIK  II IIKCT  UMR  HOWS  FER  KOSTH*./. 

sm  •  AM  EWIVKOT  WITS.  TK  KSKTS  SOL  K  II  TENS  OF  IKK  OUTS.  USA.  IF  TOO  SISK  TO  Ml”./. 

SIM  *  A  COMJtTlVE  AVERAGE  APPROACH.  ALL  TM  KQ  M  IS  ACCKUTE  TK  MTA  IAS  IR  THAT  HAMER.*.//. 

SIR  *  TK  PRACNR  IECIM  IT  TRAKTOMtHO  TK  IRFST  MTA  TO  COMM  UKMITHM.  LOC_LJKAI*./. 


nnmmiinmmnmmmmmminmmn 


*  REGRESSION  IS  THE*  PERFORMER  M  FOLUMSi  t  KOESSn  OR  U«  T  tECRESSEI  OK  Hi  ARP,/. 

*  FlHKit  T  SCKSSO  ON  NTH  It  AW  12.  OBSERVE*  IIRECT  UN*  REMIREHEHTS,  PREBICTEB",/, 

*  IIRECT  UN*  REOOtRENEHTS,  MB  KS10UALS  WE  PS  WTO  »  OtlC  INAL  (URTRMSFORREBI  RMHI  FOR",/, 

*  EACH  REGRESSION  SITUATION.  (I  ADDITION,  SUMMIT  STATISTICS  ARE  PRINTER  FOR  EACH  NOBEL.  THE"./. 

*  SUBMIT  STATISTICS  IMCLUDE  TUO  COEFFICIENTS  OF  DETERMINATION  R  SBUAREB  LOC  ANB  R  SOUAREB*./. 

*  ACTUAL.  THE  R  SUMRER  LOC  REPRESENTS  THE  C000NESS  OF  FIT  OF  THE  NOBEL  TO  THE  TRANSFORMER" ./i 

■  BATA  (LOC  FOHI).  THE  R  SOUARO  ACTUAL.  OH  THE  OTHER  HAM.  IS  COMPUTED  US  IK  THE"./, 

"  MMNSFOKQ  RESIDUALS.  AM  IS  REPRESENTATIVE  OF  HOH  HELL  THE  HM&  FITS  THE  UHTRANSFOMB'./i 

*  BATA.  THE  BURRIHMTSOI  STATISTIC  IS  CALCUUTER  FBI  ASSESSIGIT  OF  AUTOCORREUTIOr,/. 

"  OF  THE  RES  INALS.') 

FORMAT  UHl.  II,//, 

"  SEVERAL  OFTTOHS  WE  AVAIUKE  HITHIR  THIS  PMCRAH  AM  CM  RE  SELECTED  IT  APPROPRIATE", /, 

"  ASHERS  TO  THE  FOLLNIIK  QUESTIONS*",//, 

'  I.  N  TO*  UW  TO  CHECX  RATA  AS  IT  IS  REAR  FROH  FILE . AN  CONVERTER  TO",/, 

■  LOCARnUB  ?">//, 

*  TES  -  BILL  CAUSE  THE  PRIITTHC  OF  A  LISTtK  OF  THE  RATIONAL  IHPUT  DATA  AS  THE",/, 

"  ASSOCIATER  L0CAAITW1C  VALUES.",//, 

"  N  -  SUPPRESSES  THIS  OPTION.",//, 

"  2.  coHPLETE  PRunoorr,//, 

'  TES  •  na  CAUSE  OUTPUT  TO  K  PRINTER  IH  FULL  FORMAT  AS  ESCRIRO  WOVE.",/, 

'  N  •  HOI  DELETE  THE  LISTINC  OF  ORERVEi,  PRQ1CTO,  ANB  RESIDUAL  VALUES*,/, 

"  KNE9  TAKES  OF  SUHNMT  STATISTICS.  IT  HILL  ALSO  DELETE  LISTINC  OF",/, 

*  INW1RUAL  MATRICES  FOR  THE  SHORTRAHCE  PRS1CT1VE  ARIUTT  OPnOHII.E.,",/, 

"  MET  THE  SMART  TAKE  HILL  IE  LISTER.',//, 

"  3.  N  TN  HART  A  COHPARISOH  OF  THE  SHORTRAHCE  PREBICTIVE  AIILITT  OF  THE  THO  DOE IS?",//, 

"  TES  *  HILL  CASE  HE  PREBICTIVE  ARIUTT  TEST  OPTION  TO  K  ACTIVATES  AW  THE  USER  HILL',/, 

"  K  TOLU  ’ENTER  PREDICTION  (MICE  (COSE  MAKERS  FOR  FIRST  AW  LAST  CASES).’",/, 

"  TK  HU  SROKJ  ENTER  THE  MJWER  OF  TIC  FIRST  CASE  TO  IE  PREBICTEB  FOU.OUEB",/, 

"  IT  TK  LSI  CASE  TO  K  PREBICTEB,  SEPARATES  IT  A  COMM.  THE  CASE  NUMBERS",/, 

"  MNT  K  INTEGER  VALUES  CHEATER  THAN  OR  ERUK  TO  2.  THE  PREDICTIVE",/, 

'  NUTT  TEST  SIHUUIES  FUTURE  PREBICHOW  IT  PERFORMING  A  STEPHISE  TRUNCATIQR  IF",/: 

"  THE  HISTORICAL  BATA.  FOR  THIS  REASON,  AM  UPPER  LIMITATION  ON  THE  NUHIER  OF",/, 

'  CASQ  TKMCATQ  MU  Kl  ((TOTAL  WRIER  OF  CASES  IN  BATA  FILE)  /  2)  -  2",/, 

"  FOR  lUmS,  IF  TOUR  BATA  FILE  CONTAINS  H  CASES,  TOUR  UPPER  LIMIT  WKU  IE",/, 

"  a  CASES.  THIS,  OF  COMBE,  REPRESENTS  OUT  TIE  MAXIMUM  NUHIER  OF  CASES  THAT",/, 

"  COKJ  ■  THKCATE1.  IN  PRACTICE  TOO  MAT  MART  TO  TRUNCATE  OUT  A  SHALL  NUWER  IT,/, 

*  ONER.  TM,  IF  TOUR  ORTA  IS  COLLECTEK  IN  RMTHLT  INTERVALS,  TOU  CAN  UOOK  AT",/, 

"  THE  PniCTIVE  AIIUTT  OF  THE  FULL  AW  RERNXI  MODELS  FOR  W  II  MONTH  TINE  SPAN  IT",/, 

"  SPEC  TFT  INC  AM  li  CASE  RANGE.  IF  TOUR  BATA  IS  COLLECTS  IN  WASTERS,  TOU  CM  LOOT./, 

"  AT  IS  PREBICTIVE  MUTT  OF  BOTH  NOBELS  FOR  AN  II  WITH  TIN  SPAN  IT  SPECIFTIK",/, 

*  •«'.  WTO  ALL  PREItCTIVE  AIILITT  TEST  SITUATIONS  ARE  PRINTER,  THE  PROCRAT,/, 

■  man  a  summit  of  the  test  resets.',//, 

"  W  •  SUPPRESSES  THIS  OPTION.",//, 

'  ♦.  10  Mi  HART  PWJECTIOR  AW  SERSITTVTTT  NATRIIP",//, 

"  Its  -  nu  CABS  PRINTING  OF  PROJECTION  AW  SWTTVITT  NATRtl.  THIS  NATIIX  PRESENTS", /. 

'  PROJECTQ  BUST  LABOR  NEQUIRflOTS  FOR  SELECTEI  PAINS  OF  CUMULATIVE  PRODUCTION*,/, 

'  PLOT  PAINTS  AW  PMOOCTIN  RATES.  THE  PROJECTION  INTERVAL  FUN  THE  CUMLATIVE",/, 

*  (MMCnON  PUT  POINT  IS  II  OF  THE  LAST  OKERVQ  VALUE.  THE  PROJECTION  VALUES",/, 

*  FOR  PRQKKTIOH  BATE  ME  71,  10,  ff.  Iff,  111,  120,  130,  140,  AW  IS*  PSKEHT  OP,/, 

IS  LAST  OCSERVQ  VALUE  BF  PROMRTIM  WE.',//, 

*  W  -SUPPRESS!  THIS  OPTTW.",//, 
tons  *  HWPEC1K.  ROTEW  IS  PREMIER  IMCT  LAM  AEWTSKHIS  M  AEStKMLS  FIR  EACH  NOBEL", /, 
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Mia  *  Ml  STORB  M  SffRRATE  FILES.  THE  VALUES  FM  TIC  STAMMS  HAM  UK  CURIE  NOKL  AAE*i/» 

HIM  *  STORES  M  A  FILE  OKIES  'STXEAM'I  THE  VALUES  FOR  THE  PRODUCT!  OK  RATE  VARtARE  ALOW./. 

HIM  *  RRR&  IS  TK  FIU  'REJHOURS'I  AM  THE  VALUES  FOR  THE  COMINES  CUR.  FRSSUCT1M  ART./. 

MUI  ■  FROMCTIOR  RATE  MR &  U  THE  FILE  'FUUJKML'.  USERS  Ml  ACCESS  THESE  FILES  FOR  ••/. 

MIAS  *  KSISML  AMLTSIS  IT  01KI  COPPER  IMPACT  STATISTICAL  PROCRARS.  IF  SESHEI.*) 


IIRERSIMMC  V  All  AMES 


1171  ALINA  ANSHES(M)tAMIM) 

MM  FUENAAE  DATAFILE 

IMS  IIICMia  ILRTI ISA)  •AATEUSAItNRSI ISA)  (Tltat  lit  (1SII  iI2(tSR)iLI(t9fl> 

HIM  AEUFISTIISA)  .PRORATE (15)  iFMStlSfi  IS)  •AOEVRttffl  lAAEVFItttl  .AESII(ZM)  _ _ 

UM  MTA  StRAAKtMNXliSURIZiSURViSSllfSSKiSUAIlTiSMUTiSIllIti 

11M  SSEiSSE1iSSCZiSSLiSSEL1iSSEL2iSSTOiSSTOIiSSTSI.SSTOLiSSTOUiSSTOU/Z1HV 

-.IIKmUAAIANIIIIIMRmMMlWIMWWmMAMMIMMMHMMlAMHMWWMMmMMWtWMmHMMH 

14AC 

IM?  PART  I  -  MCII  FROOMAi  USTRUCTIOMi  DATA  IMTi  SATA  TRAMFAARATIMi  AM  OPTIM  SELECTIONS. 

IAAC 

. . ********************** . . 

UM  MINT  ll«  _ 

UN  U1S  FORMTUr  THE  CONUUmE  PROMCTTOK  AM  FROOBCTTM  RATE  COST  HOOEL'I 

1UAC  MSIROCTIONS  OPTIM  SBiCTIM 

. . . 

1  m  OPTIM  ASSAM 

USA  0FENlFH£»,U)CFUE,.URIT»4f  ACCESS* 'LUCM*. STATUS* 'IMOMBM 
UM  OFOKFUE*'STBCURVE’I 
ISA  OPOKFIU**REOCURVE>) 

UM  OPEKFUE*  'FULCURVE1 1 
U7I  0PER<FIU*’$T0LEAM>) 

1ZSA  OFERIFILE* 'ffiDHOUAS’ I 
UN  OPEI(FlLE*,FUiJIOOL,l 
UM  CLOSE  (FILE* 'STICUWE'l 
13M  CLOSEIFUE^’RESCURVE') 

I3ZA  CLOSE  If  IU*'FULCam') 

UM 
UM 


FIIRT  M 

M  FORM! (lino  TOO  HART  IRSTRUCTIARTI 


ISM  IM  IRFOT.  MSSER(l) 

1ST*  IF  (AHSmUl.a.’HOI  OS  TO  ME 
UM  IF  (ARSHERUl.a/TET)  CO  TO  Ml 

ISM  FROTt*  ARSUER  TES  OR  M  0K.T  FLEAM* 

MM  PRIIT  i*  * 

14M  CS  TO  IN 

MM  IM  HURT  S 
MSI  PtXRT  4 

M4A  1AZ  PRIRT.*CORPLETE  PRIRTORT 
MM  IRPRTfAMIS) 

MM  IF<AMtS».E0.*Ma.M.4MU).a.TEr)M  IS  ATI 
M7»  PRMTfUm  TES  OR  M  MLT  PlEAK" 

MM  CS  TO  lit 


umc  am  nc  mta  am  imstm  nc  vmiakes  to  iocarithns 
aac 

ISM  472  MOT  24 

ISM  a  FOMTIlliTUDSE  Ota  TK  OAK  OF  TOUR  MTO  FILE*) 
1SS0  IWTi  SATAF1LE 

UM  KM<MT*IU.OUI(l)'«CKE3 

1371  M  M  IM.KASES 

ON  OEM(MUFH£i*IUiU)iHRS(I)iFLOTII)iMTE(l) 

ISM  III)  ■  ALOCIIMBU)) 

um  nm  •  coeinPLorm) 

ltM  nm  •  ALOCMIMTEII)) 

UM  NnEU.UlI.KDtlKDinm 

UM  24  FORMT  UX.12.U.F0.7.21.F1.7.21.F0.7) 


1444 

SUMS 

•  sum  ♦  mm 

1454 

sum 

•  sum  •nm 

UM 

sum 

•  sum  ♦  nm 

U7I 

sun 

•  sun  ♦  nil 

UM 

SSll 

•  SSXl  ♦  1MIIM2 

MN 

SS22 

•  SSK  *  n<I)M2 

17M 

SST 

•  SST  ♦  T(I)**2 

1714 

suaii 

•  SMUT  ♦  ll(I)tTll) 

1724 

S0NI2T 

•  sumr  ♦  minim 

17M 

sntn 

•  siain  ♦  uuxnti) 

1744 

34CMIUK 

UMC  into  ocomptim  saarm 

1700  mn  35.MTAFOE 

I7M  35  FORMT (II i*00  TON  HART  TO  OBK  OOTI  M  IT  IS  OEM  FUR  FILE  *.M.*  Ml  CONVERTED  TO  LOCARITHHS"! 
ION  M3  WUT.ARSUEK2) 

UM  IF  (RNSNER(Z)  .El. "NO*)  CO  TO  1M 
lOM  IF  (MBWm.EO.TET)  CO  TO  1M 

MM  MINT.*  MONO  TES  ON  M  OUT  FLEASE* 

MM  CO  TO  113 

umc  predictive  warn  test  arm  selectin 

MM  !I0  MINT  M 

MM  M  FORMT(1I.*00  TOO  MNT  0  CUMRtSOR  OF  TK  SMKTMNGE  MEJICTIVE  MlUn  OF  THE  TIN)  NOOELS*) 

IMS  MS  WUT.ANSHEK3) 

MU  IF  <«SOt3).EO,HH  CO  TO  U4 

m>  IF  (MWERU) .U.TES*)  CO  TO  213 

MM  MINT.*  ANSKA  TB  OR  «  OKI  PLEME* 

MAO  CO  TO  MS 
MSI  ZS3  MUT  42 

IfM  42  F0RMTI1I.*E)IT9  MEUCTIN  MRS  (CME  AUUERS  FOR  FIMT  AM  LOST  CASES)*) 

1071  MN  INPUT. ITRUK.ITOEUF 
MM  IFnCA$E$-lTMHCH.lE.ICASES/2*2)C0  TO  lit 

mo  mini  mm 

MM  MM  F0MTI1H  .MONO  OF  CAKS  WOT  EKED  AtLMAUI  MW  MERTER  <MER  OF  CASES  TO  K  TMNCATEIM 

2910  Cl  Tl  Iff# 


mac  PROJECTION  AM  SENSITIVITT  NA1RII  OPTION  SELECTION 


2M  1H  (HINT  45 

Wf  45  FORMTIUiDQ  TOW  VMT  PROJECTION  W  SEMSITIVITT  NATRII*! 

21M  117  INPUT, ANSRERUI 
2111  IF  <ARSNER(4).E1.HH  CO  TO  IN 
2121  IF  (ANSNEJU4)  .EO.'TES*)  (0  TO  IN 
2131  PRINT.*  ANSNER  TES  OR  NO  OUT  PLEASE* 

21N  »  TO  117 

21UC  DECIN  DATA  CHECK  OPTION 

21N  IN  IF  (ANSUfflttl.El.TRH  CO  TO  IN 
21N  POINT  51, DATAFILE 

22N  St  F0RRATllHl,//,73<"»*>>/, 52, "INPUT  OATA  AS  (EM  FMN  FILE  *.M>*  AN  CONVERTED  TO  LOCARIDItS", 
221N  /,  73  ("»")) 

2221  POINT,"  LINE  DIRECT  UNO  HOUB  •  CUM  POOI  PLOT  POINT  *  PRODUCTION  RATE* 

2231  POINT,"  MINER  RATIONAL  LOCARITW  «  RATIONAL  LOCMITN  «  RATIONAL  LQCARITHH* 

22W  N  41  I* I, CASES 

2251  PRINT  35,LNIt)»*S(n.TUI,PL0T(II.UU>,RATEtI>,l2tI> 

2241  55  F0RRAT(ll,lliU,31rF0.2,tI,FT.7,*  •  -,F8.2,ZX.F9.7»“  »  ■,F0.2,2I,F».7J 

2271  4IC0NTINUE 

229#  PRINT  45 

22N  45  FORMT  IU,73(**")I 

23N  IN  CONTINUE 

Z32K 

233K  PART  II  -  PEARSON  CORRELATION  COEFFICIENTS  AN  REGRESSION  ANALISIS 
2344C 

234RCititMii::is:m:i:mtmi::>mm:>mt]is:s:M:imtimtms:t<n:i::i:::i]i::i!iiiiii::m:i:: 

237IC  CALCULATE  AN  PRINT  PEARSON  CORRELATIN  COEFFICIENTS 

23N  RUT  >  (SUNIlT-SOnUSUHT/NCASES)  /SORT ( (SSIl-  (SUNU»»2/NCASES>  )»(S$T-  ISUNThZ/NCASESI I ) 

24N  RXZT  >  (SUM2T-SURT2*SI»1T/NCASES)  /SORT I ISSI2-  (SWIZM2/CASES)  )*(SST-  l$UNT»»2/NCASES)  1 1 

2411  RI1X2  •  (SIN1X2-SUHU*SUIU2/NCASES)  /SORT!  ISSU*  (SUHI1H27NCASES)  I*(SS12-(SUM2h2/NCASESI  )  I 

2421  RUU  •  1.1 

2431  RI212  •  1.1 

24N  NTT  •  1.1 

2451  PRINT  71,RTTitUT<l22T , RUT, RUU  ,RUX2,RI2T ,011X2,07212  _ 

2441  71  FflBMTOI,///,  II, 45  ("•*), Ml, "PEARSON  CORRELATION  COEFFICIENTS  *,' 

247N  ■NATRll*,/,U,43("»"),//>4l»"*">JIi"T">4I,***i3I,"U"i5I,*»"i3I, 

240N  "T2’>/.II,43<*»">>/>ZI,*T",3I,3<*«  ", Ftl.7, III, /,1J,43C**I, 7,21, 

inn  *u*,a,3(**  •.Fii.7,ii),/»ix»4sc»"i,/,2i,"x2*,a.3i**  *,fii.7,  in  •////» 

251K  CALCOUTE  AN  PRINT  THE  REGRESSION  RESULTS  OF  TOE  STANDARD  LEARNING  CURVE  NOEL 

2531  11  »(SWIUT*  ( (SUNIHSUHT 1  /CASES!  |  /  (SSU-  (SUNX1H2/NCASES)  I 

234#  TIN  •  SUNT/NCASES 

2351  KM  •  SUMS /CASES 

2541  HIM  •  SUmi /CASES 
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87i  bear  •  surxz/cases 

zsm  m  *  run-  u*i  iim 

239#  AW  •  If. <>U 

24M  IF(ARS13).£0.*1«nPRtNT  773 

ttll  773  P0RllATt//U»7Sl*V)./l«.,,AESULTS  Of  STAWAM  IEARN1C  CURVE  N0HEL‘) 

248  tF(ANS(3l.£8.*l)*)fl)  TO  771 

2431  print  n 

£Mf  73  F0*RAT(1I.73("**)./. 141. "RESULTS  OF  THE  STAWAM  LEARNIHC*. 

243K  ■  CURIE  ROOa'»/«U.7S("»*)i/»U.l,CAS£*i3l*l'OtSERVEB*tSl>*?REBtCTEB*. 

2448A  3I.-RESI0UAf.31.*!  DEVIATION") 

871  774  00  Ilf  1*1  iNCASES 
2401  TRAIL  «  H  *  It  •  1111) 

7491  RESIOL  »  tlD  •  TRAIL 

77M  ssai  >  ssai  *  RESIN.  **  2 

2711  SSTSU  >  SST0L1  ♦  (1(1)  -  TIM)  H  2 

2721  WIT  «  If  »  TRAIL 

2731  RES1BU)  •  MSU)  •  THAT 

2749  PERCENT*  (RESH(I)/  HRS(II)  *  IN 

2731  $$£1  *  SSE1  *  RES1KIIM  2 

274#  SST01  «  SST01  *  (HRS(!)  •  MtSBM)  «  2 

2771  «mrST0l£Altr.2t>THAr.KSI0<ll 

27RI  8  F0RRAT(F8.2iF4.2) 

279#  1F(AK(3).£B.*RO-)CO  TO  111 

28N  PRINT  Mil>MR3(I).TMAT.A£5I0(I).PERC£)IT 

81#  81  F0RRAT(lI.I3.4IiFt.2>4Z.F0<2i31.F8<2i7IiF4t2) 

88  111  COHTINUE 
293#  CLOSE <FILE*'STNiAM<) 

2841  CALL  STSTERC/SORT***  sm£A8NiSTBCU«VEi2R»l-l.-2*il2MI) 

213#  SO  2771  1*1  .CASES 

284#  READ) 'STDCURVE' .*) THAT .AESIO(I) 

2841  SURRESIJ*SUWESIO*AE$IB(I)**2 
87#  IFCI.CT.il 

288#  R£SIBIF*AESI0(I)-RES1»(H) 

28N  RESHIF2*RESI0IF**2 

29N  RESTBSW*RES1BSU)MSSUIF2 

298  Q9IF 

293#  2771  CONTINUE 

2141  NSTAT*RESISSUn/SUHRESII 

2951  SlflS£SIB*RESItSUR*# 

217 PC  CALCULATE  AM  PRINT  STATISTICS  FOR  (RE  STAWAM  UAWINC  CURVE  ItOOa 

299#  8M  N0F8*NCASES*2 

3#M  TRSRL  *  (SST0L1  -  SS&l) 

3111  TRSEL  •  ssai  /  WFD 

3*8  SEE  •  SORT  (TRSEL) 

393#  VMM  *  SEE  Ml  /  CASES  *  HIM  **2  /  ($811  -  (SURI1  M  2  /  CASES))) 
Mil  (CM  s  CQffT  (VMM) 

3901  SOI  •  SEE  /  (SWT  ISStl-  (SURDhZ/CASES)  ) ) 

3#M  BS8L1  •  (SST0L1  •  SSai)  /  SST0L1 

3871  ISOAl  •  (SSTOl-  SSEl)  /  SST01 
3*8#  FIAT ID*  TRSAL  /  TRSEL 

.  3#W  PLEAM*  (18  **  (It  «  ALM1N2.#)))  *  IN 
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jin  print  8t.H.ja«.*M>ii>s£ii.Asa.i.sa.TiBa>maL.FUTio.ivi.itstti^UMi.MtTir 

am  ti  fosMi(u.7j(*«')t/,»,'nc  eouation  rat  ms  rooel  i$»  _ 

J12M  •  that  >  n  *  u  h  ii-./.ji. 

J1JM  *IN  LOC  FOB)  THIS  IUJ0EL  KCOCS)  LOetTHAT)  >  IOC (III  ♦  It  •  LDCtHI'i 
J14N  /•U.IMEREi  10C(M)  •■.FD.S.AI.’STD  EMM  •*iFI.5.4Ii‘tl  *“.F11.5. 

Jim  /iijti’ii  •‘•Ft.Siiiitre  am  «*.fi.s* 

Jim  mii*suimt  sutistics!‘.mi. 

Jim  n  squares  loc  >*,F7.5.ini-STj  error  est  ••.fu.i./.ii. 

JIM  *!BE’.lJl#*»*.Ff.5.«.1iarIUli,«*.F».J.y,lli 

Jim  T  RATIO* *fl«"** iff. 4«Bli*1.  F.  IM/II  •  l/MJ./ll. 

32M  1  SOUAREI  ACTUAL«*if7.5.IIiTEAIIINC  FACTOR  ••ifl.Si*  PERCENTi 

JZm  /1I.*BOA»IN-VATSON  STATISTICS  f.4 
mm  /iiiiTsccn 

J 24IC  CALCULATE  AM  KMT  THE  RECESSION  RESULTS  FOR  TK  REDUCES  M  VS  RITE  IMEL 

32SKi>iin:iiiiiiiiiiiiniiiti!iiiiiii!ii:miimiimtmiiitiitiiim:itnimimimiuti:mitim 

JZU  K  *(SUm2M(SUHU«SUm)/NCASESM/<SSn-(S»n2H2/NCASESI> 

JZ7I  N  «  IMS  -  K  •  mm 

J2M  AM*1«mm 

J2SI  IF(ANS(3I.EO.*TES*)CO  TO  3KI 
33N  PRINT  m 

J31I  821  FQRNAT(//lXi73(**")/llXi"RESULTS  OF  KOESSION  OR  PROOUCTIOM  RITE  VARIABLE  ALONE*) 

3321  CO  TO  3861 
3331  3*21  PRINT  82 

3341  12  FQRHATdIi73(*t*)i/illlt*R£SXTS  OF  RECRESSION  ON  PROBUCTION*. 

33M  *  RATE  VARIABLE  ALIM’,iMIi73(*»*liMIi"CASE’i31i"0*$tRVED*i5Ii 

33M  *PREBICTEl*iSl.*RES10UAL*fSIi*1  DEVIATION*! 

3371  38U  00  111  WiRCASES 

J3N  THATL  •  II  *  R  *  Kill 

33N  RESIX  *  Til)  -  THATL 

34N  $$02  >  SSEL2  ♦  RESIX  Hi 

3411  SST0L2  •  SST0L2  6  ltd)  -  TBM)  h  2 

3421  THAT  »  II  h  THATL 

3431  RESID(I)  •  HRS(l)  -  THAT 

3441  PERCENT*  (RESIDdW  HRSdll  »  IN 

3451  SSE2  *  SSE2  ♦  RESlSd)H2 

3441  SST02  >  SST02  ♦  (HRSd)  •  HRSIARI  M  2 

3471  UNITE  (*REBH0URS"t2IITHATiRESlld) 

3M  IF(ANS(3).EQ."MT)C0  TO  U1 

34W  PRINT  M«IiHRSd)fTHATflE$nd)iPEKENT 

33N  111  CONTINUE 

3SIS  CLOSE  (FILE* 'PEW OURS') 

3511  CALL  STSTEHI'/SORTHt  RESH0URSIREKIIF«l2ni-lf2M334ll 

3521  DO  3314  tM.KCASES 

3531  REMCREOCURVE'  •*)  THATiRESIDd) 

3531  SUHRESlD*SUHRESI04R£SIId)H2 
35M  lFd.CT.l) 

3551  AESllIF*RE$lDd>-AESI0d-l) 

3541  RESII1F2*R£SIDIFh2 
3571  R£$ItSUR*AESIDSUH*RESllIF2 
3540  EMIF 
MU  3314  CONTI** 


Mil  «tBTAl*«ESIOSUH/SUMIESll 

hu  samit^csiosuM 

MIC  CALCULATE  Ml  FH1HT  STATISTICS  FOR  IK  REDUCE]  HRS  VS  RATE  HOKL 

MM  334#  TKSRL*  (SSTQL2-SSEL2) 

M7I  TKa  •  SSEU  /  HOT 

SAM  SEE  •  SORTITRSEL) 

MW  VMM  «  SEE  /  (1  /  CASES  ♦  QIM  «  2  /  (SSU  -  ISSUE  H  2  /  CASES))) 

37M  SEN  *  SOU  (VARM) 

3711  SEK  *  SEE  /  (SORT  (SS12  -  (SUHTC  »  2  /  NCASESD) 

3721  RSSL2  «  (SST0L2  •  SSEU)  /  SSTOU 
3731  RS8A2  •  (SST02-  SSE2)  /  SST02 
3744  FRATTO*  TKSRL  /  TRSEL 

3731  FUHT  83iMiSEMiAMiK>SERiRSaUiSEEtTIISELiTKSRLifRAn0iMniRS8A2fMSTAT 

37M  S3  F0RHAT<lI73C«-mmc  ESUATIOH  FOR  THIS  ROOEL  ISl  * 

377M  •  TKIT  «  M  »  B  »  S2*t/*1I 

37m  -n  loc  nn  fits  ma  kcocsi  lnithat)  •  ukimi  ♦  k  •  lochej-i 

37m  /tlli"WEREi  UKtlf)  •".F8.3.4I,*$TD  ERROR  **iFI.3i4Ii"W  *",Fll.St 

3MM  / 1 131 1 "IS  **>FS.St«liaSTD  ERROR  >"rF8.5i 

M1K  / 1  Hi  "SUMMIT  STATISTlCSi'i/ilXi 

3S2M  "I  SOMREB  UK  •"iF7.3illIi"STI  ERROR  EST  <"iFll.fi/rlli 

TIM  "HSE"il3Xf"*"iF9.3i01t"HSR"illli"**iF1.3i/ilXi 

3MK  "F  RATIQ"i1Ii**"iF9.4i#Ii“D.  F.  (N/OI  •  l/*il3i/illi 

3*5*  "R  SQUARES  ACm*"F7.3/lI"WBIR-«ATS«  STATISTIC*"F?.i/U73("»“)> 

307K  CALCULATE  AM  FRIRT  THE  RBRESSION  RESULTS  FOR  THE  Fill  IKUEL 

3RVR  DEHOR  *  <<SSX1-11OT«SOTI1*<SS12-IZ3AR*SUR12)  -  (SHM2-IlSARtSUII2>*»2) 

3MR  It  *(  (SSQ-12MR*SUU2)  M$UHI1T*I1IM*SUHT)  • 

3V1H  (SHXU2-IllASiSUin2) »(SUHX2T-12MR«SUHT) I /OEHOH 

3121  12  •  <(SSI1-I1MR*SU1U1)  »($IK12T-IZIM«SMT)  - 

31M  (SUU2-IlMR*SUHI2)*(StMllT-IllM*SUHT) )  /DEHOR 

314#  M  *  TSM-IUIltM-82«IZlM 

3131  AM  «  II.HM 

JUS  1F(M3(3I.E8."TES"1CQ  TO  4321 

3171  FRIRT  84# 

3NR  84#  FORMAT  l//llr73("**)/ilt "RESULTS  OF  CORUNEI  CUHUUnVE  PROMCTIOH  AH  FHONCTIOR  RATE  MEL") 
JIM  C8  TO  434# 

4111  432|  PRINT  04 

4ltf  14  F0HRAT(lIi73("»")i/ifXi*RESUL7S  OF  COHIIHEB  COROUniE  FR0MCTI0R"i 
4#2M  "  AH  PMRHCTIOR  RATE  inga"i/ilXi73<’ni/ilIi"CASE"i31i"01SERVEI"i3Xi 

4#M  ■fH£9ICTEJ"t3Xi*RESlDUAL*i51i"l  DEVIATION") 

4R4R  434#  DO  112  t*l.CAS£S 

4IM  THATL  »  M  ♦  H  ♦  11(1)  ♦  12  *  12(1) 

4MI  RESIDL"  TU)  -  THATL 

4i7i  ssa  •  ssa  ♦  residl  h  z 

MM  SSTOL  •  SSTOL  ♦  (Till  -  TMR)  *•  2 

44M  THAT  »  U  H  THATL 

AIM  AESlUn-  HH(t>  •  THAT 

4111  FERCERT*  (RESINII/  HRSIIU  •  ill 

4121  JSE  »  SSE  ♦  RES1IUIM  2 
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4i3i  ssro  *  ssn  ♦  (tasm  •  hrssaai  **  i 

4144  WniTUWWH’iaiTWT.KStim 

4131  IFIAHOISI.EO.-NQ-ICO  TO  112 

4141  PKIKT  M«liMSU)>nMTil£Stlll)iPaCaT 

4171  tUCOniME 

4173  CUKE(riU*'nm«00L'l 

41M  C4LL  STSTEHl’/SORT***  RUm:nUUME12Mf-li-2'i43M) 

4110  M  3844  I«t.NCJISES 

42N  READ  'FVLCURVE'  i*l  THAT iRESlOl I) 

4201  SWESIS*SWCSIIW£StOU)H2 
4211  IF1I.CT.1I 

4221  R£SIDIF*AESI01l)-l£Sllll*ll 
4230  A£SIDlFZ*R£SI0IFw2 
4248  R£S10SUR»RESID$UH**ESI»IF2 

4240  ENMF 

4271  3144  CONTINUE 

42M  SHSTAT*RES1D$UN/$UHR£SII 

4241  SUHRES 1 0  «RE3 1  SSJR  >4 

43MC  CAIXUUTE  Mi  «liT  STATISTICS  FOR  THE  FULL  IOOEL 

4330  3810  RSFS‘CASES-3 

4340  TRSJtL  •  (SSTOL  -  SSQJ  /  2 

4350  trsel  •  ssa  /  mn 

4340  SEE  •  SORT (TRSEL) 

4370  ZVM.  >  KASESMSSI1  •  SSQ  -  SN11I2  M  2)  -  SUH1MSWI1  *  SSQ  • 

43SH  aniu  •  sun 2i  *  sunn  ( sunt  *  snuz  •  sstt  *  suu2> 

4310  AVAL  •  (SSI1  •  SSE2  -  SRIU2  *»  21  /  ZVAL 
4400  VAMO  >  TRSEL  «  AVAL 

4410 _ sao  •  son  ivahsoi 

hu  soi  •  sooTiirasa » issn  •  mm »  simrii  /  oemoi 

4430  $02  •  SOnilTICa  •  ($511  -  I1IAI  •  9*11)1  /  KHOHI 

4440  ASOL  •  (SSTOL  •  SSEL)  /  SSTOL 

4430  8S0A  •  (SSTO  -  SSO  /  SSTO 

4440  FMTIO*  TUSH  IVOB. 

4470  Fit  «  (RSOL  -  8SflL2l  /  (II  -  ASOL)  I  (OCASCS  •  311 

4400  F12  •  (RSOL  -  ASJL1I  /  111  -  ASOL)  /  INCASES  -  31) 

4410  ram  83i8lfSE10iAIOill<$EIliFlltl2iSE12>F12iR$8LfSEE>TRSELiTRSRLiFRATIOtMntRS8A«OIISTAT 

4300  S3  F0RHAT(lI.73(*H|./tUi"THE  EQUATION  FOR  THIS  HOOEl  IS>  *. 

43108  *  THAT  *  SO  »  11  »  SI  *  12  H»2*i/»llr 

43208  *11  LOC  FOUR  THIS  NOia  BCCOtCSi  LOC(THRT)  •  LOCIIOI  ♦  II  »  L0CII1)  ♦  12  •  L0C(12)*i 

43308  /.1Ii*WBE>  LOC(N)  •*>FI.5>41i‘STI  OMR  •■rF8.3»41."IO  ••tfll.St 

43408  /il3I.'U  >*.FI.3t4If’STi  ERROR  .*tf 8.3.41, “F«  «*.F10.4./. 

43318  I3I»*I2  *"if4.3i<Ii’5TJ  ERROR  **.F».J.41,T«  f.FIM.MI. 

43408  *S*HART  STATlSTICSi’.MI.-R  S8UAREI  LOS  >*iF7.3ilfli 

43708  "STI  ERROR  EST  *^F11.4'/,lS,raSr,I3I."«NF1.3,N,raSRa,llli"<a,F1.S,/,lIi 

43008  *F  RATI0MI,"**iF1.4.8l,*B.  F.  11/01  •  Z/M3./,Hi 

43108  1  SQUARES  ACTOAL'TT.S/irOURlIH-UATSOH  STATISnC>‘F1.4/1173Ciatl 

llAOCmmiinumiiiiiiiiiiiiiiiiiiiiiiiiiimiiimiiiimiiimiiiitiittutmiiimniinmmim 
44  IOC 

442SC  ran  m  *  raoicnn  noam  test  ootior 

4430C 

UMH . - . - . 
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us  if  (Man <3)  .ca.ir)  co  to  iu 

MU  IF (Ml  (3)  .Efl.TOTHIHT  4173 
441  I1MC«KftSEMTMNCH 
4471  ITOEUMCASES-ITOEUM 
4400  10  113  !»iTOEUMTMK 
441#  ITEST  •  CASES  ♦  1  -  I 
47M  4173  FORRATl//) 

471#  lFMKI3).£0.*«nC0  TO  41N 
4721  FOOT  84.ITEST.HRSUTEST) 

473#  84  f0RAAT(lI.IU(*»*)./ilI.‘**i371."SH0RTAAACE  FREOtCTlVE  AMUTT  *. 

474*8  t«W»IS0ir. 371.  *♦*./.  II.  *«*.l*l. 

473K  TOE  BATA  PRESEXTE9  OSjOH  IS  FM  CMC  r.I3.*  MUCH  HAS  AN  MSEWET. 

47418  *  VALUE  0F«'.F».2.UI.*»’./i 

47708  lI»114(**T./lIt"**>3I»‘#*>3Ii***.1Ii,,H£8UCEI  (lEAMIK  CURVE)  *. 

47888  •HOOEL*.#3.,,H-,3X.“flU  (OMLATIVE  PW8UCTI0R  (  WOBUCTIOR  KATE)  *. 

479#8  TMELMXi-V./.lX.MV  CASES  M8011T./.1I.M  USES  • 

48M8  TREIlCnOR  ♦  1  BCVIATIIM  *  EST  81  •  EST  It  «  *. 

48118  TREHCTIOR  *  X  8EV1AT10R  »  EST  H  *  EST  II  *  EST  K  •*. 

4R2#8  /.IMIAI’**)) 

403#  410#  SO  114  JM.IUMC 
484#  I  CASES  *  ITEST  -  1 

«#  sm  H 

408#  SOHll  «l 

4070  sum  •« 

408#  SSX1  •  8 

48V#  ssxx  ■# 

4VM  sunn  *  « 

411#  5*1121  •  I 

4121  SR21I2  •  I 

413#  00  113  KM.ICASES 

4i4#  sun  •  sum  ♦  too 

4is#  sum  •  sum  ♦  him 

ns#  sum  >  sum  ♦  atm 

417#  SSX1  •  SS31  *  I1(K>  »  2 

418#  SSI2  *  $$12  ♦  X21K)  H  2 

411#  swm  *  sunn  *  nm  *  rm 
sm  sumr  •  sumi  *  coo » rt» 

s#i#  snm  >  smm  ♦  tun  » uao 

S#Z>  113  COW  ICE 
sm  ICOUHTA  •  ICOUKTA  ♦  1 

3*4#  TIAR  »  SORT  /  (CASES 

sm  nm  •  sum  / 1  cases 

3*4#  I2MR  •  SUHX2  /  I  CASES 

“sw  iu  •  ismiT - 1  isurTiTsum)  i  icaSESi)  /  (E&li  -  rsUKi '**'27  TOSEsJ  f 

310#  HR  «  TOAR  •  SIR  *  HIM 

SM  INI  •  U  w  MR 

SIN  IWTt  «  1#  w  (MR  *  HR  •  11  (ITEST)  I 
311#  DEW  •  HRS  (ITEST)  -  THAT* 

312#  AKVKICflUEIA)  •  ANI8EVR) 

313#  SHUREVR  •  SU4AIEVR  ♦  (UEVROCOUHTAI 

314#  FCVR  *  IN  •  KVR/WdTEST) 

SIN  AMUR  •  ANIFIEVR) 


w 


I 


I 

>: 

I 

f 

1 


SIM 

sin 

51M 
SIN 

sin  at 

Sill 
SUN 

s» 

smn 
so# 

SIM 

sen 

SM 

SIN 
S3M 

nu 

3321 

son 

534# 

5354 
S3M 

53N  IK  ff(«S(3l.a.‘Mt<0  TO  m 

S3M  HURT  ff,lC«m,TMTR,PKMiMff,lll,rMTF,nEVF,Mff,ltF,lff 
S3N  17  faW»T(lI.*»*,a,I3,a,M*,lI,f».2IZl,-««r31,F*.lf4I."l*,F4.MI, 

54N4  "•",F0.3tlI,*M<>,tX*Ff.2i22,‘4a,3I(Fi.2)4Ii*t*,Ff.2,IXi"**,F0.5,lI, 

S41N  *•",#1.3,11, *•"! 

S4t<  lu  nan i we 

543#  IF(NB(3).a.*tr)C0  T#  3SN 
344#  M1IT  M 

S45#  n  FORMT(lX,lM(aial, 7/////I 
S4M  53N  C0UNT*C0URT*1. 

547#  FUCl  •  COITT  /  1.1 

S4#f  Fua  •  fuci  -  mriFucn 

S4N  IF  (FUK  JC.I.I)  a  TO  113 

S3M  113  CONTINUE 

SSI#  AVCMEVR  •  SUNKEN  /  [COMM 

552*  4VCMEVF  •  SUMOEVF  /  ICOUNTI 

ss3#  m  m  i  •mount* 

5S4#  SMEW  *  SSOEV*  *  (MENU)  •  MCMEMlHl 

535#  SSKW  •  SSOEVF  *  (MEVFIll  •  AVCISEVFIhI 

S3U  Uf  CSRTIWE 

SSncoiuuiiisiimiiiiiiiiiiiummumiiuiiiiiimutiiuiiimtiiiiiiiummiitmitiiiiimii 

55NC  CMXUUTE  Ml  PSIMT  RESULTS  SUMMIT  FOR  FREStCTtVE  4IIUTT  TESTS 

SOMCtoiimuuiiiiiiiiiiiiuiimmsmimmtiiusiisiisimissiiimiiitiiutimiiiiuuimmti 
SM#  VMMEN  *  SS8EVR  /  (ICOUNTI  •  II 

Sill  SMMEVF  >  SSOEVF  /  (ICOUNTi  •  II 

5*2#  teststat  > 

5*3#  KEXTER  *  IN  •  {COUNTER  /  [COUNT* 

SM#  fCEXTCR  >  IN  •  ICOUNTCR  /  [COUNT* 

5*5#  FCOTEF  •  IN  •  ICONTEF  /  ICOUNTI 

SiM  FCENTCF  *  IN  •  [COUNTS#  /  [COUNT* 

5*71  HUNT  N^NCMEN,*VCMEN,VMMEN,VMMCVF,TESTSTIT,  ICOUNTI, 


IF  UMEM.eT.l#.#)  CO  TO  2#1 
ICOUNTCR  «  ICOUNTCR  *  1 
1#  (4F0EW.CT.J.#)  CO  TO  HI 
I COUNTER  •  1 COUNTER  *  1 

SOW  •  I  (SSI1-I1IM*SUNI1)*ISSI2-I2SAR*SUN[2I  -  ISNItlMUNHUmiWtl 
I  IF  •  ( ISS12-I21MiSURRJ«<SUUlT-niM«SUNT)  • 

(aBia-II«MNUKll4<Saair*I2IM<SURT)l/IEMR 
Iff  •  USSlt-lllM|iSSNll)*(SURI2T-I2IM*SUNT)  • 

(SaiU-IlMMUnUMSUniT-UIMMUNTD/OEMR 
NF  *  TIM  -  ILF  •  IIMI  -  Iff  t  12SM 
INF  •  1#  h  NF 

writ  *  t#  «  imf  ♦  iif  ♦  iiinEsn  ♦  iff  •  airrEsni 

OEVF  *  NSUIEStl  •  THMTF 
MEVFIICOUNTII  •  IN  (OEVF) 

SUNMEVF  >  SUMKVF  *  MEW  I  ICOUNTI) 

FSEVF  •  IN  •  0EVF/WSUTEST1 
4HEVF  •  MSINEVn 
IF  (MEUF.CT.IO.I)  N  TO  IK 
1C0UNTCF  •  ICOUNTCF  *  1 
IF  (NKVF.CT.S.II  CO  TO  HI 
ICOUNTEF  »  ICOUNTEF  *  1 


( I 


* 
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- 
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S§iiiiiiSif3mSiiil!lig£33gi|ll£jflg$f|iS§igigigiii 


icouma,  icsura.  iioumef,pcemer«pc£mef,  icomtoi.  icoomcf  ,pcemm, 
pcemcf 

IS  F0RMTIH,47(***)f/,II,***tlW,*SUMMT  OF  PREHCTM  MIUTf  TESTT*, 

■  AESuLTS"»ta.-»*,/»ii«47(-**),Mi.-*-,vi,-iTEM  of  ihterest-.m, 

•»  icsuca  ma »  nu  ma  *-.mi.47(**->,mi.**  avemce  *. 
■Mttunc  OEVIATMT, 71, *»*>», FV.2,M,-*-,a>FV.2, 31, •**>/»lI« 

**  VMIAKE  OF  AOOtUlE  OEVMTIOK-,a,"*MI,Fll.l,3I,**-,FU.:,3I, 
***,MI«'*  TOT  STATISTIC  (SEE  MIEl*»3l,***,41.*~*.4I.,**,a, 
FV.2.M, ■»*./, II,-*  TRIAL  MMEI  OF  TEST  SITORTKM  •-,41,13.41.-**, 

51. 13.41,  -»*,/,lI<'*  IRRHEl  OF  PREHCTKM  OITHW  01  *‘.41, 13,41, 
•»*.S1.I3.4I****»/«1I,*»  KKEIT  OF  PRaiCTlOM  KITH  I*  St  •*,4I,F».», 

3x,-**,si<f4.i,n,-**,/.ti«*»  mm  of  prerictiow  mtmii  in  **, 

41. 13. 41,  -**,n,13Ml, ■»*,/,«,••  PERCEXT  OF  PREllCTtOM  OITHW  ill**, 
U,F4. 1, 0, *»*, SI, F4.1, 51, ***,/, II, 47(***l, /,  11, "WTEi  W  TESTWC  FOU  *, 
•STATISTICAL  SICMFICAKE  USE  STUKXT’S  T  llSWIRITlOr./.lX 

■IF  WE  MMEI  OF  TEST  SIWATIOK  ME  UESS  WM  Ml  OTHER! (SE  *, 

USE  STAMAAT./.U.-ROAML  OISTUMTIM.  W  EITHER  COSE  WIS  IS  *, 

*»  OK  TA1L0  TEST.  IF*,/, 11, -THE  TEST  STATISTIC  IS  CREATE!  WM  *, 
-THE  CRITICAL  STATISTIC  OK  MT*,/,lI,TORCUflE  THAT  WE  AKRRCE  *, 
‘MSO.UTE  OEVMTUM  0*T»IW  UIW  WE  FUU.-,/,II>*1WEL  IS  *, 
•SICMFICAML!  LESS  WM  WIT  OMAWEI  KITH  WE  REOUXB  MB..*) 

TUT , "FILES  UXFtU,STK£OM,KMQUK,MI  FULUOTL  (RUTTER." 


PMT  IV  -  FMJECT1M  Mi  SEKITIVTTT  MWII  OPTIM 
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111  IF  (MSUB(4>.Ea.-M*1  SO  TO  IS 
ADOPLOT  •  PLOT INCASES) 

DO  117  I<1,1M 

AOOPLOT  >  AOOPLOT  ♦  .11  *  PLOTWCASES) 

REHPLOTU)  •  in  (AOOPLOT) 

A96RATE  >  .41  *  MIE(KMES) 

00  lit  J-l.V 

AIOMTE  >  MKATE  ♦  .1  *  RATE  UKASES) 

PROMTS  (J)  <  AIOMTE 

FWS1I.JI  •  AM  *  NOPUmilMOt  »  PHMTEU>**K 
IK  CatTIMJE 
117  COMIRUE 
1ST ART  •  1 
ISTOP  >51 
OR  IK  1*1,1 

PRUT  8f,  (PROMTS U),U*l,f) 

01  FMMT(lI,U3(-t*),/,lI,'**,3n,miEniM  AM  SEMITTVITT  HATRU", 


3W,***,/,1I,U3(*»*), /,«,“»  PROJECTED  **,34I,TR0J£CTE0  PMOUCTMT 
*  MTET, 341, '**,/, 11, •»  CUMULATIVE  **,«(•»•>, /,«,*•  UMTS  »*, 


VlFO.l, a, -»•),/, 11, U3C»TI 
00  m  1‘ISTART, ISTOP 
PRIM  fOriaPLOT(!),IFMI(ItJ),J*l,f« 

VO  FQRMTItl,’**, 31, 14^1,'**, Fill, fl.l,II,***n 
U1  COMIRK 


*  UM  n  FOMTaiilUlf)) 
m»  man 

UU  K  FMNT(lIi"M1E>  t.  PNOJECIEB  VALUES  FOR  IIMCT  UUN  HOUB  Ml  *i 
4Z3K  "IE  REAR  FRRR  T*  MOVE  MTRI1  It  MTCM1M  I  CIVEM  PRODUCTIOr.Mli 

am  *mte  lira » civa  mr«  of  cumutive  units  im  remino  the  *• 

MSN  "VRU*  FOR  IIRECT  UIOR  HOURS  FOUM  NT  THE  INTEWECTIOR"i/iIIi 
am  *RF  THE  CRRESPORRIRE  ROM  MR  CX1M.  FQRECISTIRt  NMEL  IS  THE  ". 
am  TUMUTIVC  PROMCTIN  1  PRODUCTION  RITE  ROQEL."i7i7li*t.  PROJECT". 

am  "TOR  HT6NRL  FOR  CUMUTIVE  UNITS  IS  »  OF  TIC  LAST  OtSERVED  VALUE". 
am  •  of  cumutive  uRns.'./.n.*}.  projection  values  for  production  *. 
URNS  "RITE  ME  71.  Mi  Mi  lMi  tlOi  ilfi  130i  IMi  MS  ISO  PERCENT  OF  "i 
Min  ‘iw./iili'ur  OKEXva  VALUE  of  promotion  M1E.*> 

43M  I  STMT  «  31 

1331  I STOP  •  IN 

1340  IM  CONTINUE 
4330  IS  STOP! 

4340  cm 


Sample  PRODRATE  Output 

This  next  section  provides  a  sample  output  of  the 
abbreviated  and  full  format  options  using  simulated  data. 

The  data  base  was  developed  by  Stevens  and  Thomerson  (16:127) 
to  demonstrate  how  the  PRODRATE  program  works.  It  should  be 
noted  the  data  were  developed  to  demonstrate  superior 
results  for  the  full  model.  The  program  instructions  are 
presented  first,  then  the  abbreviated  format  followed  by  the 
full  format.  This  comparison  of  the  optional  formats  will, 
hopefully,  demonstrate  the  value  of  the  abbreviated  option. 


PRORATE  IMSTRUCTtONS 


this  program  is  iesicks  to  evaluate  the  variation  in  direct  labor  reouirekdits  as  a 

FUNCTION  OF  CUMULATIVE  PRODUCTION  AM  PRODUCTION  RATE.  IN  ADDITION.  THE  ANAUST  MT 
COMAIE  THE  RESULTS  OSTA1NES  FROM  THE  STANDARD  LEARNING  CURVE  HTTH  THE  RESULTS  OBTAINEB 
FRO  THE  CUMULATIVE  PRODUCTION  AM  PMOUCTIOR  RATE  MOREL*  THE  COST  MIELS  USES  IN  THIS 

PtQCRAI  ARE) 

t.  RESUCO  Rosa  I  ST AMAH  LEARNING  CURVE  IBKU 
T  •  M  *  (U  h  111  «  (II  m  E) 

t.  FULL  MSEL  (CUNULATtVE  FMOUCTIOR  AMD  PRODUCTION  RITE  WOOD 

1  <  N  I  (11  H  III  I  IQ  H  KI  t  (II  H  E) 

KKi  T  IS  THE  IIRECT  UXOR  REQUIREMENTS 

XI  IS  THE  CIMUTIVE  PRODUCTION  PLOT  POINT 

n  IS  THE  PRODUCTION  RATE  PMIKE.C.  EQUIVALENT  WITS  PER  AONTHI 

E  REPRESENTS  THE  ERRON  TERN 

Mt  Hi  AM  K  ARE  PARAMETER  0ETERNIKS  IT  REGRESSION 

DATA  AM  INPUT  IT  REAIINC  FROM  AN!  PROPERLT  FORMTTD  DATA  FILE.  TOUR  DATA  FILE  SHOULB 
K  SAVES  TO  ANT  PERMNENT  FILENAME.  TOO  HILL  K  ASX  TO  INPUT  THE  NAME  OF  TOUR  DATA  FILE 
AT  THE  APPROPRIATE  STEP  IR  THE  PROGRAM.  THE  MME  OF  TOUR  DATA  FILE  CM  MT  EXCEED  0 
CHARACTERS.  THE  FIRST  LINE  OF  THE  DATA  FILE  MUST  CONTAIN  A  LINE  NUMKR  AM  THE  MJMtER  OF 
CASES  TO  K  REM.  THE  OATA  IS  THEN  ENTERED  OM  CASE  PER  LINE  IN  THE  POLLOUIMC  ORDER* 

LINE  NUMKR.  OBSERVES  IIRECT  UXOR  REQUIREMENT  (T).  CUMULATIVE  PRODUCTION  PLOT  POINT  (XI). 

RM  PRODUCTION  RATE  PROIT  (IX).  THE  PROGRAM  USB  A  FREE  FIELD  REAI  FORMAT!  THEREFORE. 

EACH  VARIABLE  MUST  EE  SEPARATES  XT  AT  LEAST  ONE  SPACE  (OR  OTHER  DELIMITER)  BIT  W  OTHER 
SPECIAL  FORMAT  IS  REQUIRES.  M  EXAMPLE  OF  A  DATA  FILE  UITR  S  CASES  IS  PRESENTED  KLONl 


IM 

tot 

9 

IM 

V.9 

t.5 

ttt 

Vf 

M 

21.5 

m 

M 

59 

29 

1M 

79 

02 

27 

119 

71 

113 

31 

OM  ANVMTKE  OF  THIS  PROGRAM  1$  THAT  THE  RESULTS  OSTAIMB  HIU.  K  IN  THE  SAME  UNITS  AMD 
POOR  AS  THE  INPUT  MTA.  FOR  E1MTLE.  IF  TOU  ARE  UORXIK  IN  IIRECT  UXOR  HOURS  PER  MONTH 
AM  EOUIVALENT  UNITS.  THE  RESULTS  HIU  K  IN  TODS  OF  THESE  UNITS.  ALSO.  IF  TOU  HISH  TO  USE 
A  CUHUUrtVE  AVERAGE  APPROACH.  AU  TOU  ICO  DO  IS  ACCRECATE  THE  OATA  IASE  IN  THAT  MANNER. 

THE  PROGRAM  WINS  IT  TRAKFOMK  THE  INPUT  MTA  TO  CONNOR  LOGARITHMS.  LOG  LINEAR 
IECMSSION  IS  THEM  PERFORMED  AS  FOLLOKS)  T  REGRESSES  OR  II.  T  REGRESSES  OM  12,  AND 
FIMLLT  T  REGRESSES  OM  BOTH  U  M  IX.  OISERVEB  DIRECT  LABOR  REQUIREMENTS.  PREDICTED 
IIRECT  UXOR  REOUIREKNTS.  ANO  RESIDUALS  ARE  PRINTEB  II  ORIGINAL  (UNTRANSFURNEB)  FORM  FOR 
EACH  REGRESSION  SITUATION.  IN  AMITION.  SUMMIT  STATISTICS  ARE  PRINTEB  FOR  EACH  ISOOEL.  THE 
SMART  STATISTICS  INCLINE  THO  COEFFICIENTS  OF  KTEMIMTION  R  SQUARES  UK  AM  R  SQUARES 
ACTUAL.  THE  R  SQUARES  UK  REPRESENTS  TK  COOOKSS  OF  FIT  OF  THE  MSEL  TO  IK  TRANSFORMS 
MTA  (LOC  FOOD.  TK  A  SQUARE!  ACTUAL.  ON  THE  OTHER  HAM.  IS  COMPUTES  USINC  TK 
MTMMSFMMO  RESIDUALS.  RM  IS  REPRESENTATIVE  OF  HON  HEU  TK  MOKL  FITS  TK  UNTRAMFORHES 
MTA.  TK  MMIR-MTSON  STATISTIC  IS  CALCULATES  FOR  ASSESSMENT  OF  AUTOCORRELATION 
OF  THE  KSIHALS. 
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several  arias  mi  availaiu  mwia  t«$  procrm  am  cm  k  selecto  it  appropriate 
MMDS  TO  TIC  FQLLMIM  OUESTIOMi 

t.  M  TOO  HART  TO  CKCK  MTA  AS  IT  1$  REM  FRQR  FIU . MB  COHVERTER  TO 

UCMITMS? 

ID  -  KOI  CHOSE  TIC  PAIHIIM  OF  A  LISTIK  OF  TIC  RATIORAL  I  SPOT  MTS  MO  TIC 


M  -  OWBB  THIS  OTIOR. 
t.  C0HPUTE  PRINTOUT? 

ia  -  mi  cmse  output  to  k  pcimteb  ii  fill  formt  as  ksdiki  move. 

m  -  VOL  KLFTE  TIC  LISTIK  OF  OSSERVEI.  FfKSICTCO.  Ml  RESIMAL  VALUES 

kwed  tames  of  mm  statistics,  it  hill  also  delete  listing  of 
naniKAL  mtiices  fos  tic  skrtrake  psoictive  aiilitt  otioiii.e.. 

MLT  TIC  SUMMT  TAKE  UILL  K  L1STD. 

1.  N  TOO  KMT  A  CSKMISOR  OF  TIC  SHORTCAKE  PKIICTIVE  AIILITT  OF  THE  TW  IBKLST 
TES  •  mi  CANS  TIC  PRDICTIVE  AIILITT  TEST  OTION  TO  K  ACTTVATQ  AM  THE  USER  UILL 

K  mil  'ana  proictioa  rake  <cme  ums  for  first  am  last  cash.' 

THE  UKR  SHOULI  ERTD  THE  HUMD  OF  THE  FIRST  CAS  TO  K  PRDICTED  FOLLOWER 
IT  TK  LAST  CAS  TO  K  FHOICTEB.  SEPARATE!  IT  A  COMA.  THE  CAS  NUMEiS 
MIT  K  INTEGER  VALUES  CREATES  THM  OR  EQUAL  TO  l.  THE  PREBICTIVE 
MIUTT  TEST  SIKLATES  FUTORE  FREItCTIOM  IT  PEKORMK  A  STEPUIS  TRURCATIOR  OF 
TK  HISTORICAL  MTA.  FOR  THIS  REASON  M  UPPER  LIRITATIM  OR  IS  HUMD  V 
CASES  TRMCATD  UOOLI  S>  ((TOTAL  HUMES  OF  CASES  IH  SATA  FIU)  I  l)  ■  l 
FOR  EIARPUi  IF  TOUR  DATA  FIU  CONTAINS  SI  CASS.  TOUR  UPPER  LIMIT  IMU  S 
a  CASES.  THIS.  OF  COORS.  REPRESENTS  OKI  THE  NAIIMR  NIMD  OF  CASES  THAT 
OKI  K  TRUNCATE!.  IN  PRACTICE  TOO  RAT  DMT  TO  TRUNCATE  ONLY  A  SHALL  HUNKS  OF 
CRKI.  THUS.  IF  TOUR  MTA  IS  COLUCTES  II  RORTHLT  IHTERVALS.  TOU  CM  LOOK  AT 
TK  PROICTIVE  AIIUTT  OF  TIC  FULL  AM  REMCD  ROOELS  FMMII  MATH  TIRE  SPM  IT 
SECiniM  M  II  CAS  RAKE.  [F  TOUR  MTA  IS  COUXCTE1  IR  QUARTERS.  TOU  CM  LOOK 
AT  TK  PROICTIK  AlILin  OF  MTU  SOROS  FOR  M  tl  MNTH  TIK  SPM  IT  SPECIFTIK 
RFTD  ALL  PRDICTIVE  AIILITT  TEST  SITUATIONS  AK  PRINTO.  TK  PKOCRM 
PRINTS  A  SURHAT  OF  TK  TEST  RESULTS. 

H  •  SUPPRESS  THIS  OTIOO 

«.  M  TOO  UANT  PROJECT IOi  AM  SCK1TIVITT  RATRII7 

ID  -  UIU  CAME  PRMT1K  OF  PROJECTIQH  AM  SEWTTVTTT  HATCH .  THIS  HATCH  PRESENTS 
PMJECTD  DIRECT  LAMR  REOUIREKRTS  FOR  SELECTS!  PAIRS  OF  CUMUTIVE  PRODUCTION 
PUTT  POINTS  AM  PRORUCTIOH  RATES.  TK  PROXCTIOI  INTERVAL  FOR  WE  CUMULATIVE 
PRMUCTIM  FIST  POINT  IS  IX  OF  WE  LAST  ORSERVES  VAUK.  TK  PROJECTION  VALUES 
FK  PRORUCTIOH  MTE  AK  71.  M.  Hi  Iff.  III.  1M.  1M.  14R.  AM  ISM  PERCENT  OF 
TK  LAST  ORSERVO  VALUE  OF  PRORUCTIH  MTE. 

M  -SUPPRESSES  THIS  OTIOR. 

•••SPECIAL  NOTE***  WE  PRDICTD  IIICCT  LAIOR  REOUIREKRTS  AM  RESIDUALS  FOR  EACH  HOKL 
ME  STORE!  II  SEPARATE  FILES.  TK  VALUES  FOR  WE  STUMS!  LEARN  IK  CORK  MODEL  AK 
STOOD  IR  A  FIU  CAUH  'STTLEARN'I  TK  VALUES  FOR  TK  PROOUCTIOH  RATE  VMIARi  ALOK 
MRP.  «  TK  FIU  'REAMURS’I  AM  TK  VALUES  FOR  TK  COMIKI  CUR.  PROMKTIOR  AM 
PROWCnOH  RATE  HOKL  IR  TK  FIU  'Fill NODI'.  USERS  HAT  ACCESS  THESE  FILES  FOR 
ksimal  MALTSIS  IT  OTHD  COPPa  ihpact  statistical  procram,  if  desired. 
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t  »  i.tmm « -0.4953710  ♦  -i.mu32 


H  *  -0.4435710  *  l.MOOOff  ♦  l.nMU 
wmwwwwHwtwwwwwHmww 

a  *  -f.mmz »  0.9444440  »  i.hoaaii 
r. 


RESULTS  OF  STMMU  LEARNIK  CURVE  MEL 


TOE  EQUATION  FAR  THIS  HOOEL  IS!  DMT 
IN  L0C  FORM  THIS  HUB.  KCOHESi  UK  (THAT  I 


M  i  II  m  It 
UK(M)  ♦  It  •  LOCIIl) 


IOC  (Ml  •  3.49572 
it  *-0.20242 

SURNRRT  STATISTICS! 

I  SQUARES  UK  >*.99113 
USE  >  0.00027 

f  «na  utss.uts 

I  SQUARED  ACTUAL1!. 98881 


STD  EMUS  •  1.13455 
STD  ERROR  >  0.10433 


If  •  3131.24884 


STD  EDDOt  EST  •  1.1144 

HSR  •  1.14391 

I.  f.  INTO)  <1/38 
LEARNING  FACTOR  <  82.21945  PERCENT 
MRSIN-UATSON  STATISTIC*  1.327753 

iiH«mHinmimiiHininHHiniiiinnminimHiimwnniim 


iiHiiiiiiiiinniiiiuminiiiiiiiiiiiiiHimwimmwnMniniinii 

^  RESULTS  OF  RECRESS  ION  OR  PRODUCTION  RATE  VARIMLE  ALONE 

THE  EQUATION  FOR  THIS  MEL  IS*  *  THAT  *  Hi  12  «  12 
IN  UK  FORK  THIS  I900CL  SECURES :  LK(THAT)  *  LOC(M)  ♦  12  «  LOCI  12) 


El  UK  (Ml  •  3.25379 
R  <-1.74392 
STATISTICS! 

I  UK  >8.94854 
USE  >  I.M894 

F  RATIO  <1149.793 

I  SOURED  ACTUAL  <1.95479 
NJRDUHMTSON  STAnSTIC*  1.277285 


STD  ERROR  >  1.23957 
STD  ERROR  >  4.12175 

STD  ERROR  EST  > 
HSR 

D.  F.  INTO)  • 


N  <  1793.84990 


0.1309 

1.11700 

1/3 


tic  ematioh  m  ntr  met  ts>  net  *  n  ♦  n  **  n  » u  **» 
w  ux  fw  nit  vm.  tecact:  lkitmti  <  locimi  ♦  11  *  uoctiu  4  a «  mini 

HOC:  LOCIMI  >  3.7538*  STB  DM!  *  4.141 14  M  «  3A7T.S44U 

11  <-4.3*57  tn  am  •  i.m»  f«  >H33Z.zi* 

k  •  i.mm  sn  aunt  •  1.M334  t* 

SVMMIT  STATISTICS) 

1  wua  ux  <4.m*  sn  dm  est  <  i.nm 

K  •  MMM  Ml  •  I.S77B 

f  MTIO  >7*1.912  I.  F.  (M/ll  <3/37 

I  SOOMQ  KTUH'I.NMf 

mbih-watsoh  statistic*  i.tttaa 


IMHHWWIIW«IIHHm»MIIIHIHIHIIItmiHHIlWIIIIIIHII 

*  sw*Mt  of  rain ive  asilit?  tests  results  • 

. . . . WHHHIHII 

«  ITEM  OF  IRTEREST  *  REDUCE]  MKL  4  FULL  MKL  • 


<  AWEJIACE  AISOUITE  OEVIATIOH  » 

* 

<tWwlfTTT 

4.1* 

m 

«  VMIANCE  OF  MSOLUTE  DEVIATIQM  • 

tl.U 

• 

Ml 

*  TEST  STATISTIC  (SEE  MTEI  * 

ft 

13.31 

4  TOTAL  MB  OF  TEST  SITUATIOM  * 

144 

• 

144 

<  wan  of  piaicTioK  withih  n  * 

138 

♦ 

144 

4  KKEXT  OF  PiaiCnOK  WITHU  SI  4 

73. 

ft 

IM. 

4  mm  of  ncsiCTinis  withih  in  4 

144 

ft 

144 

4  FEKEHT  OF  FRESICTlOHS  WITHIH  in* 

IN. 

4 

IN. 

■TE!  [H  TESTIM  FM  STATISTICAL.  SICMFICAHCE  USE  STBKHT'S  T  DISTRISUTtN 
IF  TIC  MME1  OF  TEST  SITUATIOK  ME  LESS  THAI  ill  OTHERWISE  USE  STAMM 
WML  SISTHIOTlM.  »  EITHER  CASE  THIS  IS  »  OK  TAIIXB  TEST.  IF 
TIC  TEST  STATISTIC  IS  OUTER  TDM  TIC  CRITICAL  STATISTIC  NE  RAT 
CMXUK  THAT  TIC  MCRACC  AISOUITE  KWIATIM  0ITAIK1  WITH  THE  FULL 
MKL  IS  S1QHFICAITLT  LESS  TWI  THAT  0STA1HE1  WITH  TK  XEDCEI  MKL. 

files  UKFM,vvum,tam*t,m  fuumsl  mittd. 
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WVT  MTA  *8  REM  FROM  FILE  TESTMTA  Ml  CORVEKTCO  TO  LOCMITWS 


LUC 

iikct  lu>  hours  » 

OH  PRO!  PLOT  POUT  4 

PRODUCT  10*  RATE 

mm 

RATION* 

UKAR1TWI  * 

RATIONAL 

UKM1TWI  4 

RATIONAL 

LOCARITHN 

m 

IfM.tf 

3.13442*1  » 

Sf  .ff 

1.41817M  4 

2.27 

1.3541254 

in 

M3,  ft 

2.447153  « 

173. ff 

2.2431381  4 

3.83 

1.38544*7 

i» 

441  .ff 

2.8M83M  4 

313. ff 

2.4135443  * 

(.45 

1.4483AM 

in 

SU.H 

2. 741881  4 

434. M 

2.4371531  4 

4.14 

1.41372*1 

iff 

4fl.ff 

2.4121441  4 

424.M 

2.71457a  4 

5.33 

1.7247272 

is* 

442. ff 

2.444442*  4 

715.11 

2.1M347!  4 

5.83 

1.7*71331 

tw 

437. M 

2.4444114  4 

IffS.ff 

3.MZ1441  4 

4.(7 

f .8111*43 

171 

444. ff 

2.4443114  4 

IZM.ff 

3.1813473  4 

4.71 

1.8247225 

IK 

341. ft 

2.3458471  4 

1413. ff 

3.174*412  * 

7.N 

f.845f1M 

Iff 

347. ff 

2.3443215  4 

t773.ff 

3.24111*3  4 

7.37 

1.8*74*73 

2ff 

33f.ff 

2.3113131  4 

2112. M 

3.3213*17  4 

7.71 

f .3113373 

w 

3Zf.lf 

2.54515*1  4 

2421. If 

3. 3831144  4 

8.33 

1.121*43* 

m 

317. If 

2.5111513  4 

27*1. ff 

3.4423221  4 

1.11 

1.1585431 

m 

313.M 

2.41354M  4 

3174.fl 

3.5118815  4 

1.8* 

1.11387*1 

zw 

341  .ff 

2.(811383  4 

3357. ff 

3.5511831  4 

lf.51 

1.1214127 

at 

344.N 

2.4828734  4 

3174.M 

3.51144*4  4 

11.17 

1.1481332 

ZM 

2fl.fl 

2.4742143  4 

4432. ff 

3.4485532  4 

11.81 

1.1718821 

Z7f 

Zff.ff 

2.4423184  4 

4444.N 

3.415*31*  4 

12.37 

1.1123*17 

ZM 

34. M 

2.4333183  4 

5431. ff 

3.7371333  4 

12.87 

1.1113783 

Zff 

271. ff 

2,4444441  i 

5151. ff 

3.7731734  4 

13.38 

1.12443*1 

3ff 

ZTt.flf 

2.4313438  4 

44*1. ff 

3.8112117  4 

t3.45 

1.1331327 

310 

Z43.M 

2.4111337  4 

4472.M 

3.8433574  4 

13.18 

1.1433172 

321 

234. If 

2. 4482441  4 

7411. ff 

3.174531*  4 

14.23 

1.1532141 

m 

23f.fl 

2.3171441  4 

8fM.fl 

3.1*74114  4 

14.43 

1.145a74 

340 

243.M 

2.3811441  4 

84Sf.lt 

3.1371141  4 

14.18 

1.1735118 

Sf 

23f.ff 

2.3783171  4 

12(8.11 

3.14*1478  4 

13.21 

1.1844173 

3*4 

235. M 

2.3711*71  4 

1848. ff 

3. 113348*  4 

15.43 

1.1143ia 

371 

232.14 

2.3*54881  4 

U45f.ff 

4.11111*3  4 

14.14 

1.2132144 

m 

22l.ff 

2.3571348  4 

11131. ff 

4.1424141  4 

14.33 

1.2133178 

in 

224. ff 

2.35*2481  4 

11424 .ft 

4.1*5* 3a  4 

14.4* 

1.2214731 

4ft 

221  .ff 

2.3443123  4 

IZ2Z7.M 

4.1873111  4 

14.97 

1.2214818 

411 

211.11 

2.33843*5  * 

12838. If 

4.11*4174  4 

17.27 

1.2372123 

4Zt 

Z14.M 

2.3344337  4 

13341. If 

4.1234487  4 

17.5* 

1.2445245 

at 

214.N 

2.3344131  4 

13841. If 

4.14141*4  4 

17.81 

1.23*4*31 

441 

211.M 

2.3242124  4 

14337.M 

4.1S*43a  4 

18.fl 

1.2353137 

431 

Zff.ff 

2.32114a  4 

1414*. ff 

4.1721141  4 

11.22 

1.2415484 

44 

214.14 

2.3138*72  4 

15454.M 

(.18114*1  4 

11.41 

1.2451338 

471 

243.11 

2  347414*  « 

I4f48.fl 

4.2134211  4 

11.51 

1.241*437 

Of 

Zff.ff 

2.3flf3ff  4 

14454.M 

4.221518*  4 

11.78 

1.273*13* 

411 

tff.ff 

2.21*4*32  4 

17172. ff 

4.23482*8  4 

18.14 

1.27738M 

. . nun . . 

peamm  concur  ion  cacmciotrs  mtiii 


•  i  •  n  »  a 

T  •  t.NMM  •  -4.1133711  •  -f.1841432 


11  •  -I.WB71*  •  l.MNN  <  1.11*4*48 

a  •  •  i.muu  #  i.  limit 
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CASE 

observed 

PREDICTED 

RESIDUAL 

I  BEV1ATIQM 

1 

IMS.## 

1434.45 

51.55 

4.74 

2 

143.44 

727.41 

75.59 

9.41 

3 

441. N 

417.19 

23.81 

3.71 

4 

544. f# 

555.41 

4.39 

4.78 

5 

493.N 

547.39 

-14.39 

-2.92 

4 

442. H 

474.25 

-12.25 

-2.45 

7 

437. M 

443.85 

•4.85 

•1.57 

1 

444.84 

421.54 

-17.54 

-4.35 

9 

348.14 

394.72 

-28.72 

-7.81 

1# 

347.44 

377.93 

-31.93 

-8.91 

11 

334.44 

344.78 

-38.78 

•9.33 

12 

324.44 

344.19 

-24.19 

-8.19 

13 

317.44 

333.34 

-14.34 

-5.14 

14 

313.44 

324.43 

-7.43 

•2.44 

IS 

349.44 

314.52 

-1.52 

-4.49 

U 

344.44 

344.94 

3.14 

1.42 

17 

294.44 

291.44 

4.54 

2.24 

11 

294.44 

282.41 

7.39 

2.55 

19 

284.44 

275.13 

8.87 

3.12 

21 

278.44 

248.39 

9.41 

3.44 

21 

274.44 

242.32 

7.48 

2.14 

22 

243.14 

254.74 

4.24 

2.38 

23 

254.44 

251.58 

4.42 

1.73 

24 

234.14 

244.24 

3.74 

1.58 

25 

245.44 

241.54 

3.44 

1.44 

24 

239.44 

237.44 

1.94 

4.82 

27 

235.44 

232.84 

2.14 

4.91 

t» 

232.44 

228.99 

3.11 

1.38 

29 

224.44 

223.52 

2.48 

1.49 

31 

224.44 

222.19 

1.81 

4.81 

31 

221.44 

219.45 

1.95 

4.88 

32 

211.44 

214.45 

1.95 

4.89 

33 

214.44 

213.48 

2.32 

1.47 

34 

214.44 

211.47 

2.53 

1.18 

35 

211.44 

249.41 

1.39 

4.75 

34 

249.41 

217.28 

1.72 

4.82 

37 

244.44 

215.42 

4.98 

4.48 

31 

243.44 

242.85 

1.15 

4.48 

39 

244.44 

244.73 

-4.73 

-4.37 

4# 

198.44 

199.14 

•1.14 

•4.31 

TIC  COGATIOH  ran  THIS  NOBEL  1S>  THAT  •  M  ♦  II  »  II 

II  LOC  FOUR  THIS  NOBEL  BECOMES:  L0CITHAT1  <  IOC (81 1  *  II  *  LOCIIU 

mesi  Locim  >  3 .vm  sti  error  >  #.13455  t#  *  3t3t.z(w 

II  *-1.28242  STI  ERROR  <  I.H433 
SUHRART  STATISTICS! 

R  SOOMO  LOC  *4.99113  STB  ERROR  EST  •  4.4144 

USE  >  MMZ7  HSR  >  1.14394 

F  RATIO  *4255.4815  0.  F.  (I/O)  •  1/  38 

t  sauna  ACTUM.*#. 98881  LEARIIIK  FACTOR  •  82.21945  PERCEMT 
MRIM-HATSOi  STATISTIC*  1.327753 


TTTTTTT7  r  ’  T  LI  tTYITTTL  LT  LI 


RESULTS  OF  RECRESSIW  ON  PRODUCTION  RATE  VARIABLE  ALONE 


CASE 

01SERVEB 

PREBtCTES 

RESIDUAL 

1  DEVIATION 

1 

1180. H 

974.04 

113.10 

14.41 

2 

843.11 

050.14 

144.90 

18.15 

3 

041. M 

591.03 

51.17 

7.83 

4 

504. M 

540.05 

13.35 

2.38 

5 

493.11 

510.01 

-23.01 

4.79 

0 

402.14 

482.14 

-23.44 

-4.34 

7 

437.44 

447.24 

-14.24 

•2.34 

1 

444.44 

435.28 

•31.28 

-7.74 

9 

304.44 

421.84 

-53.04 

-14.02 

II 

347. N 

445.94 

-58.94 

-10.99 

11 

334.44 

389.54 

-59.54 

•18.M 

12 

324. M 

374.04 

-54.04 

•15.01 

13 

317.14 

347.29 

-34.29 

-9.50 

1C 

313.41 

320.91 

-13.91 

-4.44 

IS 

349.14 

311.74 

-2.74 

-4.89 

10 

344.M 

297.93 

0.17 

2.84 

17 

29S.N 

280.12 

11.98 

4.12 

II 

291.14 

no.  IS 

13.85 

4.77 

19 

284.14 

201.13 

15.07 

5.59 

21 

271.14 

204.49 

17.51 

0.34 

21 

VIM 

250.05 

13.35 

4.95 

22 

203.14 

252.13 

14.87 

4.13 

23 

250.  N 

248.02 

7.18 

2.84 

24 

254.14 

243.54 

0.54 

2.04 

25 

245.11 

239.54 

5.54 

2.25 

20 

239. H 

235.87 

3.13 

!.3t 

27 

235.44 

231.83 

3.17 

1.35 

28 

232.  M 

227.02 

4.38 

t.89 

29 

228.14 

224.41 

3.04 

1.58 

31 

224.44 

221.29 

2.71 

1.21 

31 

221  .M 

218.27 

2.73 

1.23 

32 

218.14 

215.45 

2.55 

1.17 

33 

210.14 

212.79 

3.21 

1.48 

34 

21C.N 

211.57 

3.43 

1.04 

35 

211.14 

218.03 

2.17 

1.13 

30 

219.14 

287.13 

1.97 

1.94 

37 

210.14 

215.44 

1.50 

1.27 

38 

MM 

214.14 

-1.14 

-4.51 

39 

284.11 

212.42 

-2.42 

-1.21 

41 

198.  M 

281.15 

-3.15 

-1.59 

THE  EQUATION  EM  THIS  WKL  1$:  *  THAT  »  N  *  12  «  82 
IN  IOC  FORK  THIS  ItGOEL  BECOMES!  LOC(THAT)  >  LOCI II)  ♦  B2  •  LOC1XZ1 
WERE:  IMIlf)  •  3.2537*1  STD  ERROR  >  1.23957  M  •  1793.00991 
12  >-1.74392  STS  ERROR  <  1.12175 
SMART  STATISTICS: 

R  SQUARES  LOC  >1.90054  STS  ERROR  EST  >  1.13(9 

USE  >  I.IM90  HSR  >  l.tlTN 

F  RATIO  >1109.7951  I.  F.  INFS)  >  1/  30 

I  SQUARES  ACTUAL*#. 95079 
DUR8IN-UATS0N  STATISTIC*  1.277285 


RESULTS  OF  COHI1HE1  CUMUT1VE  PMOUCTIOH  ADS  PROOOCTIOR  MTE  WOa 

HWWMWWmmWWWII  WHHHUmtiltmtMtlWMMHHIUHMH 


CASE 

OBSERVES 

PREDICTED 

RESIDUAL 

I  OEVIAT 

1 

1188.4* 

1*88.13 

•*.13 

-*.81 

2  M3.M 

8*3.13 

-*.82 

3 

441. If 

44*. 73 

*.27 

(.84 

4 

54*. M 

541.19 

-*.*9 

-*.82 

S 

493. 1* 

492.47 

*.33 

(.87 

4 

442.M 

441.92 

(.18 

8.(2 

7 

437.4* 

437.1* 

-(.If 

-8.82 

• 

4*4. *« 

4*4.12 

•*.12 

-8.83 

t 

348.1* 

348.24 

•*.24 

-».*7 

If 

347.M 

347.14 

-*.*4 

-f.ft 

11 

33*. M 

329.59 

(.41 

(.12 

a 

32*. I* 

319.39 

(.41 

1.13 

13 

317.M 

317.5* 

-«.5( 

-(.14 

14 

313.M 

313.28 

-1.28 

-*.*9 

IS 

3ff.fl 

.  3*8.97 

1.13 

(.81 

14 

3*4.44 

3*4.32 

-1.32 

-(.If 

17 

298.4* 

297.89 

f.tt 

8.(4 

11 

291.4* 

291.43 

-*.45 

-8.15 

If 

284.4* 

283.75 

1.23 

(.89 

3* 

278.M 

278.21 

-*.21 

-8.87 

21 

27I.M 

249.54 

(.44 

(.14 

22 

243.8* 

242.3* 

(.2* 

8.88 

23 

254. f* 

233.53 

(.47 

8.18 

24 

25f.ff 

251.29 

-8.29 

-*.11 

23 

245.4* 

244.84 

(.14 

1.87 

24 

239.1* 

239.34 

-4.34 

-8.14 

27 

235. If 

235.87 

-*.* 7 

-*.*3 

28 

232.4* 

231.43 

(.37 

(.14 

n 

2Z8.M 

227.91 

1.89 

1.14 

38 

224 .1* 

224.38 

-*.38 

-*.17 

31 

221. ff 

221.13 

-«.  13 

-*.** 

32 

218.M 

217.97 

1.13 

(.12 

33 

214.4* 

213.93 

*.H 

8.(2 

34 

214.M 

213.78 

(.22 

f.lf 

33 

211.4* 

211.38 

-f.38 

-4.18 

34 

2*9. ff 

218.88 

8.12 

8.(4 

37 

2*4. M 

215.88 

(.12 

8.(4 

38 

2*3. M 

2*2.83 

8.15 

(.87 

39 

2M.I* 

2ff.2f 

•8.2* 

-f.l* 

4# 

198. ft 

197.97 

8.(3 

8.(1 

THE  EIMTIOR  FOR  THIS  WOE.  IS:  THAT  *  If  t  It  «  It  »  12  »*K 

II  UK  FORK  THIS  IN  DEL  IEC0HES)  LOCI  THAT  I  >  LOCIM)  ♦  11  t  L0CIX1)  ♦  12  t  UKII2) 


WERE!  LOCIM)  >  3.7538* 

11  -*.59937 

12  >  1.84494 
SWART  STATISTICS: 


STB  ERROR  <  i.Mtti 
STD  ERROR  >  I. 11134 
STS  ERROR  <  4.11334 


M  >  5473.84448 
Ft  >8*332.21*9 
Ft  >54384.94*4 


1  SQUARES  IOC  >8.99999 

STD  ERROR  EST 

>  8.8M4 

USE  >  (.(***< 

HSR 

*  8.577*3 

F  RATIO  >7988.2812 

D.  F.  ll/ll 

•  V  37 

1  SOARED  ACTUAL*  1.1**** 

WRtlt-MTSOH  STATISTIC*  2.38*328 

lil  >  >>>ii..ma 

■  Itf lilflf ff ffl 

UliHIIIIMMilHMIHMMI 
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*  SWRTRAKE  PREDICTIVE  ABILITY  COMPARISON  .  * 

*  HE  BATA  PRESENTED  80.00  IS  FOR  CASE  A  41  4H1CH  HAS  AX  OBSERVED  VALUE  OF:  198.11  * 

HMH*HWWH«H4HimHWHWWWWWWWHWWWWWWWHWHHtHHHHHHHHWHHHHHHWIW 


REDUCED  (LEASNINC  CURVE!  MODEL 


FULL  (CUMULATIVE  PRODUCTION  t  PRODUCTION  RATE)  MODEL 


PREDICTION  «  X  DEVIATION  ♦  EST  II  »  EST  It  H  PREDICTION  «  l  DEVIATION  «  EST  II  «  EST  Dt  *  EST  82 


PREDICTION  *  X  DEVIATION  <  EST  BB  »  EST  II  ♦♦  PREDICTION  *  X  DEVIATION  *  EST  81  •  EST  81  *  EST  82  • 


38 

% 

241.83 

♦ 

-1.42 

•  3127.21  *-1.28244  m 

2M.21 

1 

-4.14 

4 

3471.21  *-4.39947  ♦  4.84473  » 

37 

t 

2M.83 

f 

-1.42 

«  3127.32  *-1.28244  «* 

211.21 

1 

-4.11 

4 

3471.38  *-4.39947  »  4.84449  » 

34 

« 

Zff.78 

4 

-1.39 

»  3129.39  *-*.28234  *« 

211. 19 

4 

-4.11 

4 

5471.34  *-4.39941  *  1.84449  * 

33 

f 

211.47 

♦ 

-1.33 

•  3133.42  *-1.28273  ** 

211.18 

♦ 

-1.49 

4 

3471.37  *-4.39938  »  4.84437  * 

34 

t 

2M.34 

4 

-1.28 

«  3137.51  *-4.28292  ** 

2H.21 

♦ 

-4.11 

4 

3471.11  *-4.59943  *  1.84449  • 

33 

* 

EM. 37 

4 

-1.19 

*  3144.39  *-4.28324  h 

ZM.19 

* 

-l.ll 

4 

3471.22  *-4.59941  «  4.84451  * 

32 

• 

EM.  18 

4 

-1.19 

*  3131.43  *-4.28337  ** 

2M.19 

♦ 

•1.19 

4 

3471.43  *-4.59937  ♦  1.84439  * 

31 

t 

199.99 

4 

Ml 

*  3138.24  *-4.28389  f* 

2M.19 

4 

-4.19 

4 

5471.17  *-4.39937  *  4.84437  « 

31 

• 

199.77 

4 

1.11 

•  3145.74  *-4.28424  h 

211.28 

• 

-4.11 

1 

3471.84  *-4.39938  «  4.84443  * 

2» 

« 

199.33 

4 

1.23 

•  3173.44  *-4.28442  *» 

2M.Z3 

4 

-4.11 

4 

3449.98  *-4.59943  •  4.84471  « 

21 

1 

199.23 

4 

1.38 

»  3184.44  *-4.28513  ♦« 

EM.  22 

4 

-4.11 

4 

3474.13  *-4.39941  «  1.84444  » 

27 

• 

191.83 

4 

1.39 

*  3198.11  *-4.28378  » 

2M.19 

4 

-4.19 

4 

5471.15  *-4.59934  «  1.84419  • 

IWI 
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SHORTRAKE  PREDICTIVE  ABILITT  COHPAR1SON  * 

THE  DATA  PRESENTED  BELCH  1$  FOR  CASE  A  38  HMCH  HAS  AN  OBSERVED  VALUE  OF:  313. H  • 

HHHHWWHHWIHHHtMtlHmmWIMHMMUtMMiilHUlHHIMIHimWIIMHHMIHHIHHKHI 


I 

CASES 

USB 


REDUCES  (LEARNING  CURVE)  NOBEL 


h  FULL  (CUNUUTIVE  PRODUCTION  t  PRODUCTION  RATE)  NOBEL  • 


PREDICTION  *  l  DEVIATION  *  EST  Bt  *  EST  It  »•  PREDICTION  *  l  DEVIATION 


37  » 

313.44 

ft 

1.13 

ft 

3127.33  *-4.28244  *♦ 

243.85 

ft 

4.47 

ft 

5471.51 

*-4.58847 

•  4.84U8  • 

3A  * 

313.84 

ft 

f.15 

ft 

3124.34  *-4.38354  ♦* 

243.34 

ft 

1.48 

ft 

5471.34 

*-4.58841 

*  4.84448  • 

35  * 

2ft.  78 

ft 

1.11 

ft 

3133.43  *-4.38373  h 

243.83 

ft 

4.48 

ft 

5471.37 

*-4.58838 

*  4.84437  t 

34  « 

3ft. 47 

ft 

4.14 

ft 

3137.51  *-4.38342  »♦ 

213.84 

4 

1.47 

ft 

5471.41 

*-4.58845 

•  4.84U8  • 

33  • 

313.44 

ft 

1.35 

ft 

3144.34  *-4.38324  m 

243.84 

ft 

4.48 

ft 

5471.22 

*-4.58841 

*  4.84454  * 

-33  « 

313.34 

ft 

f.3S 

ft 

3151.43  *-4.38357  u 

242.84 

ft 

4.18 

ft 

5471.13 

*-1.58837 

*  4.84438  * 

31  * 

2ft.  If 

ft 

1.44 

ft 

3158.24  *-4.28384  ** 

243.84 

ft 

4.48 

ft 

5471.17 

*-4.58837 

*  4.84437  * 

31  « 

211.84 

ft 

f.55 

ft 

3145.74  *-4.28424  «♦ 

242.85 

ft 

4.41 

ft 

5474.84 

*-4.58838 

«  4.84443  < 

38  • 

241.  U 

ft 

I.U 

ft 

3173.U  *-4.28443  H 

243.88 

4 

4.44 

ft 

5U8.88 

*-1.58843 

«  1.84471  * 

31  * 

311.35 

ft 

1.81 

ft 

3184.44  *-4.28513  H 

242.87 

ft 

4.44 

ft 

5474.45 

*-4.58841 

*  1.84444  * 

37  » 

Zff.44 

ft 

l.fl 

ft 

3148.11  *-4.28578  •* 

243.84 

f.fl 

4 

5474.15 

*•4.58834 

*  1.84418  * 

ZA  • 

3*4.57 

ft 

1.24 

ft 

3311. U  *-4.28438  *» 

242.85 

ft 

4.48 

ft 

5U8.88 

*-4.58834 

*  4.84433  * 

EST  84  ♦  EST  II  »  EST  K  ♦ 


SHORTRANCE  PREDICTIVE  ABILITT  COMPARISON 
THE  DATA  PRESENTED  BELOU  IS  FOR  CASE  f  37  UHICH  HAS  AN  OBSERVED  VALUE  OF: 


IH.H 


REDUCES  (LEARNING  CURVE)  NOOEL  **  FULL  (CUMULATIVE  PRODUCTION  t  PRODUCTION  RATE)  MODEL  • 
PREDICTION  »  I  DEVIATION  <  EST  IB  »  EST  II  «  PREDICTION  «  I  DEVIATION  *  EST  SI  i  EST  II  <  EST  BZ  « 


34  • 

245.44 

ft 

1.45 

»  3138.38  *-4.38354  H 

245.87 

ft 

1.44 

ft 

5471.34  *-4.58841  «  4.84448  ♦ 

35  • 

244.84 

ft 

4.51 

*  3133.43  *-4.28273  h 

245.84 

ft 

4.47 

4 

5471.37  *-4.58838  «  4.84437  » 

34  • 

214.85 

ft 

»  3137.51  *-4.28383  ** 

245.88 

ft 

1.45 

ft 

5471.41  *-4.58845  *  4. 84448  « 

33  « 

244.44 

ft 

»  3144.38  *-1.28334  « 

245.87 

ft 

4.44 

ft 

5471.22  *-4.58841  »  4.84454  ♦ 

33  • 

344.47 

ft 

4.74 

*  3151.43  *-4.28357  ♦* 

245.87 

ft 

4.44 

« 

5471.13  *-4.58837  *  4.84438  * 

31  t 

344.28 

ft 

4.84 

»  3158.34  *-4.28388  H 

245.87 

ft 

4.44 

ft 

5471.17  *-4.58837  »  4.84437  * 

34  * 

214.17 

ft 

4.84 

*  3145.74  *-4.28424  <* 

245.88 

ft 

4.44 

ft 

5474.84  *-4.58838  »  4.84443  » 

38  » 

243.84 

4 

1.45 

•  3173. U  *-4.28442  ♦* 

245.81 

ft 

4.44 

ft 

5448.88  *-4.58843  *  4.84471  » 

28  « 

343.53 

4 

1.24 

*  3184.44  *-4.28513  ♦* 

245.84 

4 

4.45 

ft 

5474.45  *-4.58841  *  4.84444  < 

37  * 

243.12 

ft 

1.44 

•  3188.14  *-4.28578  «* 

285.87 

ft 

4.44 

ft 

5474.15  *-4.58834  »  4.84418  ♦ 

24  * 

243.75 

ft 

1.58 

•  3214.44  *-4.28438  « 

245.88 

ft 

4.44 

ft 

SU8.88  *-4.58834  ♦  4.84423  ♦ 

Ml 

35  * 

243.33 

ft 

1.78 

*  3324.28  *-4.28713  •* 

245.81 

4 

4.44 

ft 

MM 

SM8.57  *-4.58844  «  1.84443  • 

SMORTRAKE  PREDICTIVE  ABILITY  CONPARISON 

TIC  DATA  PRESENTS)  KUM  1$  FO#  CASE  f  34  WICK  MS  AD  OtSOtVED  VALUE  OF*  249.44 


SMORTRAKE  PREDICTIVE  AIILITT  COMP  ARISON 

DC  DATA  PRESENTS)  CLOU  IS  FOR  CASE  4  33  UHICH  MS  AR  OSSERVEI  VALUE  OFi  211. H 


REDUCE)  (LEARNING  CURVET  NO  DEL  h  FULL  (C1MJLATIVE  PRODUCTION  t  PRODUCTION  RATE)  HODEL  « 


«  PREDICTION  ♦  I  DEVIATION  *  EST  Bf  «  EST  B1  M  PREDICTION  *  X  DEVIATION  *  EST  Bf  <  EST  II  •  EST  K  « ■ 


1.51  *-4.28292  H 
1.39  *-4.28324  h 
I.A3  *-#.28337  « 
I.Z4  *-#.2838#  H 
1.74  *-#.28424  » 
1.44  *-1.28442  ♦* 
1.44  *-1.28513  H 
1.1#  *-1.28578  » 

1.44  *—#.28438  « 
1.2)  *-1,28712  m 
1.48  *-#.2879#  H 

1.45  *-#.28914  h 


*-4.59945 
:  *-#.39941 
*-4.59937 
*-#.59937 
.  *-#.59938 
1  *-4.57943 
♦-#.59941 
*-#.59938 
♦-4. 39931 
*-4.59941 
*-4.59932 
*-#.59947 


*  4.84449  * 
«  4.84454  * 

*  4.84439  • 

*  4.84437  * 

*  4.84443  * 
«  4.84471  * 

*  4.84444  « 

*  4.84419  * 

*  4.84423  « 

*  4.84443  * 

*  4.84435  * 
»  4.84494  * 


SHORTRMCE  PREDICTIVE  A8ILITT  COMPARISON  * 

nc  MTA  NtSEITO  taou  IS  rat  CASE  I  3«  UHICH  HAS  M  OBSERVES  VALUE  OFl  2J4.II  * 

mWWWWWWWmWHHWWHWIWHWWHHmWWIWWHIWWWWIlWWIWHWWHWWWH 

8  «  AESUCES  ILEARNINC  CURVE)  MOSEL  *♦  FUi  (CUMULATIVE  FROSUCTIM  t  PRODUCTION  RATE)  IBIS.  « 


CASES  «* 
ISO* 

PREDICTION  4  1  DEVIATION  4 

ftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftftft 

EST  84  *  EST  Bt  **  PREDICTION  *  l  DEVIATION  * 

EST  18 

n.iimm 

VVVVfVVVVIl 

«  EST  81 

Iftftftftftftftft* 

•  EST  n 

M 

ft 

33  * 

211.12 

* 

1.35 

ft 

3144.34  *-8.28324  *« 

213.78 

4 

4.14 

ft 

5471.22 

*-8.54441 

•  8.84454 

32  * 

214.42 

• 

1.44 

ft 

3151.43  *-1.28357  ** 

213.78 

ft 

4.11 

ft 

5471.43 

•-8.54437 

*  8.34434 

31  * 

214.74 

* 

1.53 

ft 

3158.24  *-4.28384  *• 

213.77 

ft 

4.11 

ft 

5471.17 

*-8.54437 

*  8.84437 

34  * 

214.53 

• 

1.42 

ft 

3145.74  *-4.28424  «« 

213.78 

ft 

4.14 

ft 

5478.84 

*-8.54438 

«  8.84443 

24  4 

214.34 

« 

1.73 

ft 

3173.44  *-4.28442  ** 

213.81 

ft 

4.44 

ft 

5444.48 

*-8.54443 

«  8.84471 

21  * 

244.44 

ft 

1.47 

ft 

3184.44  *-8.28513  ♦* 

213.81 

ft 

4.84 

ft 

5478.45 

♦-8.54441 

•  8.84444 

27  » 

244.54 

« 

2.14 

ft 

3148.14  *-8.28578  *• 

213.77 

ft 

8.11 

ft 

5474.15 

*-8.54434 

•  8.84414 

24  * 

244.21 

ft 

2.24 

ft 

3214.44  <-8.28438  «* 

213.78 

ft 

4.14 

ft 

5444.48 

*-8.54434 

*  8.84423 

25  * 

244.84 

t 

2.43 

ft 

3224.24  *-8.24782  «* 

213.82 

4 

8.44 

ft 

5444.57 

*-8.54448 

*  8.84443 

24  » 

248.18 

ft 

2.72 

ft 

3244.48  *-8.28744  « 

213.84 

ft 

8.84 

ft 

5444.24 

*-8.54432 

*  8.84435 

23  * 

247.43 

ft 

3.47 

ft 

3248.45  *-8.28414  ** 

213.84 

ft 

8.48 

ft 

5444.51 

*-8.54447 

*  8.84444 

22  4 

244.44 

imiiiHi 

ft 

3.51 

Hftftftftftlft 

ft 

ftftftft 

3248.24  *-8.24858  « 

213.78 

uiiiim 

ft 

Hftftl 

f.tf 

*4 1«  ftftftft 

ft 

ftftftft 

5441.71 

•ftftftftft««4 

♦-8.54424 

fftftftftftftftftftl 

♦  8.84547 

fft 

IHHIHIIIIIIimmWIIHIim«HIIIHIIHHHHIIIHH<HHmWtH«mWHmmiHmiHHMHIIIIHimHW 


SHORTRAKE  PREDICTIVE  ASILITT  COMPARISON 
THE  BATA  PRESETS!  SELflll  1$  PSt  CASE  A  33  WICK  MAS  A*  OBSERVES  VALUE  Off 


214.88 


A  *  PENCES  (LEARRIK  CURVE)  MODEL  H  FULL  ICBHBUTIVE  PROOUCTIOH  S  PRODUCTION  RATE)  XOOEL  t 

USER  *  PRESICnON  «  Z  DEVIATION  •  EST  N  <  EST  Bt  «  PREDICTION  *  X  DEVIATION  *  EST  BB  *  EST  Bt  *  EST  BZ  * 
. . . 


32 

ft 

213.14 

ft 

1.33 

ft 

3151.43  *-4.28357  *♦ 

215.44 

ft 

8.43 

31 

ft 

212.45 

ft 

1.41 

ft 

3154.24  t-4.28384  *♦ 

a3.44 

ft 

8.43 

.34 

ft 

212.74 

ft 

Ml 

ft 

3145.74  *-4.28424  H 

215.45 

ft 

8.83 

24 

ft 

212.51 

ft 

1.41 

ft 

3173.44  *-8.28442  » 

215.48 

ft 

8.81 

21 

ft 

212.9 

ft 

1.74 

ft 

3184.44  *-4.28513  « 

215.47 

ft 

8.81 

27 

ft 

211.84 

ft 

(.44 

ft 

3148.14  *-4.28578  ** 

215.44 

ft 

8.43 

u 

ft 

211.43 

ft 

2.12 

ft 

3218.44  *-4.28438  H 

215.44 

ft 

8.43 

a 

ft 

211.42 

ft 

2.31 

ft 

3Z24.a  *-4.28782  w 

U5.48 

ft 

8.81 

24 

ft 

214.44 

ft 

2.94 

ft 

3244.44  *-8.28744  ** 

215.44 

ft 

8.42 

a 

ft 

244.45 

ft 

2.44 

ft 

3248.45  H.2S414  t* 

214.88 

ft 

•8.88 

u 

ft 

248.71 

ft 

3.34 

ft 

3248.24  *-4.24458  «* 

215.45 

ft 

8.43 

a 

ft 

247.34 

ft 

3.44 

ft 

3334.74  *-4.24254  h 

215.41 

ft 

8.44 

5471. A3 
5471.17 
547B.84 
5444.48 
5474.15 
5474.15 
5444.48 
S44V.57 
5444.24 
5444.51 
S44B.7I 
5447.42 


*-4.54437  « 
*-4.54437  « 
*-8.54438  » 
*-4.54443  » 
♦-4.S4441  * 
*-4.54434  * 
*-4.54434  » 
*-4.54444  » 
*-4.54432  » 
*-4.54447  » 
*-4.54424  ♦ 
♦-4.54442  » 


4.84434  • 
4.84437  * 

4.84443  * 
4.84471  * 

4.84444  • 
4.84414  « 
4.84423  • 

4.84443  * 

4.84435  • 

4.84444  * 
4.84547  * 
4.84537  * 


IH»WW4HIHHimnn»l*H*»Mmi*HHH**IHH*HIIH*MHMHH*IM**MHHt**H*IIIH4IHHIM4MM»H*«m** 
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MMTMKE  PfiEBICTIVC  AttLITT  COWMISM 

AC  HAT*  PtESEXTQ  KLOU  IS  FOX  CASE  4  32  (MICH  HAS  M  OSSEWQ  VALUE  OF*  218.4* 


3*  * 

as.  u 

4 

1.31 

4 

3145.74  *-4.2*424  M 

221.12  * 

-4.44 

« 

5474.84  *-4.5443*  •  4.(4443  • 

24  • 

217.84 

« 

1.41 

4 

3173.44  >-4.2*442  « 

221.14  • 

-4.47 

• 

5444.9*  *-4.54443  *  4.84471  • 

a  • 

217.5* 

4 

1.55 

4 

3114. 44  *-*.2*513  » 

221.15  • 

-4.47 

t 

5474.45  *-4.54441  *  4.84444  « 

o  » 

117.11 

• 

1.73 

4 

3 14*. If  *-4.2857*  H 

221.12  * 

-4.45 

• 

5474.15  *-4.54434  *  4.84419  * 

a  « 

21i.il 

t 

1.4* 

4 

321* .44  *-4.2*438  *# 

221.12  * 

-4.44 

• 

5444.4*  *-4.5443*  *  4.84423  * 

a  * 

214.44 

4 

2.N 

4 

3224.2*  *-4.28712  h 

221.14  * 

■9.17 

• 

5444.57  *-(.5444*  »  (.*4443  * 

M  • 

215.7* 

4 

2.34 

4 

3*44.4*  *-4.2*744  H 

221.14  « 

•4.44 

« 

5444.24  *-4.54432  ♦  4.84435  » 

a  * 

215.44 

4 

2.71 

4 

3248.45  *-*,2*414  h 

221. 1*  * 

-4.4* 

4 

5444.51  *-4.54447  «  (.8444*  » 

a  » 

214.11 

4 

3.12 

4 

224*. 24  *-4.24(58  « 

221.12  « 

-4.44 

• 

5448.7*  *-4.54421  «  (.8*547  * 

a  * 

212.71 

4 

3.72 

4 

3334.74  *-4.24254  h 

221.14  * 

-4.(4 

« 

5447.42  *-(.544(2  «  (.84537  • 

a  « 

211.44 

4 

4.5* 

4 

3343.84  *-4.24513  h 

221.4*  * 

-*.*• 

• 

5444.33  *-(.5484*  •  (.**334  « 

w  « 

211.74 

4 

5.54 

4 

3444.N  *-4.24*53  H 

221.(2  * 

•(.(1 

» 

5444.(4  *-4.54*44  •  (.84344  * 

139 


REIOCEB  (UMKNC  CURVE)  TOC. 


H  FULL  (CtMUUnVE  PRODUCTIM  (  PRODUCTION  RATE)  TOEl  * 


PROICTIM  ♦  X  DEVUTIM  «  E5T  M  *  ESI  II  M  PREBICTI08  *  I  9EVIAT10N  «  EST  II  •  ESI  II  «  ESI  K  • 


a 

« 

721.14 

ft 

1.32 

ft 

3173.44  7*8.28442  H 

S4.41 

ft 

•8.18 

a 

« 

221.73 

• 

i.tt 

• 

3184.44  7*1.28313  H 

224.48 

ft 

•8.18 

V 

• 

221.33 

ft 

1.44 

• 

3178.11  »-8. 28371  77 

34.37 

ft 

-8.17 

a 

« 

217.74 

• 

1.81 

• 

3218.44  7*8.28438  7# 

224.38 

ft 

-8.17 

a 

1 

217.34 

ft 

1.78 

« 

3224.21  7*8.21712  7* 

34.41 

ft 

•8.18 

74 

( 

218.74 

ft 

2.24 

ft 

3244.48  M.2I777  H 

34.48 

ft 

-8.18 

a 

• 

211.28 

• 

2.37 

• 

3241.43  7*8.28714  77 

34.43 

ft 

-8.17 

a 

« 

217.24 

• 

3.11 

ft 

3271.27  7-8.27838  77 

34.a 

ft 

-8.17 

71 

• 

213.74 

• 

3.41 

• 

3337.74  7*8.27234  h 

34.34 

4 

-8.13 

a 

• 

214.a 

* 

4.37 

t 

3373.17  7*8.27313  77 

224.24 

ft 

-8.12 

17 

• 

211.72 

* 

3.37 

t 

3444.88  7*8.27833  m 

34.27 

ft 

-8.12 

11 

ft 

217.27 

• 

4.37 

1 

3347.33  7*8.38248  77 

34.17 

ft 

-8.18 

I  H.JW3 
i  »-i.jmi 
7-8.57731 
7-8.37738 

i  7-8.57732 
7-8.37747 

I  H.5WI 

H.sm 

I  H.31M 
t-8.37847 
:  M. 37777 


7  1.84471  # 

*  1.84444  7 

*  1.84417  » 

*  1.84473  » 

*  1.84443  • 
«  1.84433  « 
«  1.84471  7 
7  1.84377  7 
7  1.84537  7 
7  1.84337  7 
7  8.84344  7 
7  1.84127  7 


*  AVERAGE  ABSOLUTE  DEVIATION  *  344  »  I.U  * 

*  VARIANCE  OF  ABSOLUTE  DEVIATIONS  •  ll.U  «  141  « 

*  TEST  STATISTIC  (SS  NOIEI  •  —  »  .  1341  • 

*  TOTAL  MlOa  OF  TEST  SITUATIONS  »  144  «  *04  • 

« number  of  predictions  uithir  st  *  m  *  w  • 

« percent  of  predictions  within  jx  *  w.  *  in.  • 

*  on  OF  PKEIICTIONS  WITHIN  til  ♦  144  *  144  I 

«  PERCENT  OF  PKEIICTIONS  WITHIN  tit*  IN.  «  IN.  • 


NOTE)  IN  TESTING  FOR  STATISTICAL  SIGNIFICANCE  USE  STUDENT'S  T  DISTRIBUTION 
IF  THE  MHKR  OF  TEST  SITUATIONS  ARE  LESS  THAN  Mi  OTHERWISE  USE  STANDARD 
■KMAL  DISTRIBUTION.  IN  EITHER  CASE  THIS  IS  A  ONE  TAILEt  TEST.  IF 
TIE  TEST  STATISTIC  IS  CHEATER  THAN  THE  CRITICAL  STATISTIC  OK  NAT 
CONCLUDE  THAT  THE  AVERAGE  ABSOLUTE  DEVIATION  OBTAINED  WITH  THE  FULL 
NOEL  IS  SIGNIFICANT  LESS  THAN  THAT  OOTAINP  WITH  THE  REDUCED  NOBEL. 
FILES  LOGFILEiSTDLEANNiRQHOUBiAN  FULLNOOL  MITTEN. 


NUCTI9  *9  SE91T1VITT  Mdll 


•  FMJECTO  • 
*0*9*219 

*  ours  « 

nojccTo  moucTiM  dates 

11.24  < 

13.13  4 

17.13  • 

11.74  * 

21.9  *  22.73  * 

24.42  * 

24.32  * 

28.41  * 

ino 

143.3  4 

142.7  4 

19.1  * 

1*44  * 

213.3  * 

22* .7  * 

2434  * 

241.7  * 

277.4  * 

mis 

144.4  * 

141.*  4 

I7t.t* 

1*3.4  * 

212.1  * 

22*4  * 

2444  4 

241.1  * 

2734* 

17417 

1*3.14 

1414  4 

177.** 

1*4.3  * 

21(4  * 

227.1  * 

242.*  * 

29.4  * 

274.2  * 

tTia 

143.1  4 

144. 1  • 

174.*  * 

1*3.4  * 

217.4* 

223.7  * 

241.3  * 

237.1  * 

272.4  * 

1«H 

141.1  4 

19*  .2  4 

ITS.*  ♦ 

1*2.3  * 

29.4  * 

224.4  * 

24*. I  * 

233.7  4 

2714  * 

itzsz 

141.1  4 

194  4 

174.7  * 

1*1.2  * 

2*7.2  * 

223.1  * 

238.7  * 

2344  * 

24*4  4 

um 

144.3  4 

137.4  4 

1734  4 

1*1.1  * 

29.1  * 

2214* 

237.4  * 

2324  4 

2444  • 

use 

tl*.l  4 

1344  4 

172.** 

11*4  * 

29.7  * 

22S.4  * 

234.1  * 

231.4  4 

244.3  * 

11717 

134.1  4 

133.4  4 

1724  * 

194  * 

294  * 

21*. 4  * 

2344  * 

294  • 

2434  * 

imt 

19.2  4 

1344  4 

1714  * 

1174  * 

212.7  * 

211.2  * 

233.3  * 

29.4  * 

243.4  * 

i**a 

137.3  4 

133.7  4 

171.1  4 

1*44  4 

211.4  * 

2174  * 

232.2  * 

247.3  * 

242.2  * 

1*232 

134.7  4 

19.1  4 

147.2  * 

194  * 

29.3  * 

213.** 

2314  * 

2444  * 

294  * 

1*4*4 

134.14 

1324  4 

1*4.3* 

194  4 

1*7.3  * 

214.7* 

22*4* 

244.7  * 

231.4  * 

1*574 

133.14 

1314  4 

147.4  * 

194  * 

19.4  * 

213.4  * 

221.4  * 

243.4  * 

294  * 

1*747 

19.4  4 

19.7  4 

1444  * 

112.1  * 

1*7.4  * 

2124  * 

227.4  * 

242.1  * 

234.7  * 

l*»l» 

133.*  4 

14*.*  4 

143.7  * 

1*1.1  * 

1*44  * 

211.4  * 

224.2  * 

294* 

233.3  * 

2W*1 

133.2  4 

14*4  4 

1444* 

19.2  * 

194  * 

21*4  * 

223.1  4 

237.4  4 

2344  * 

mu 

132.5  4 

141.4  4 

144.1  * 

177.3  * 

194  * 

29.2  * 

223.7  * 

29.4* 

232.7  * 

9434 

131.*  4 

147.7  4 

143.1  * 

19.4  * 

19.4  * 

29.2  * 

2224  * 

237.2  * 

231.3  * 

2S444 

131.2  4 

144.*  • 

1424  4 

177.3  * 

1*2.4  * 

2*7.1  * 

221.4  * 

2344  * 

29.2  * 

9771 

19.3  4 

144.2  4 

141.3  * 

174.4* 

1*1.4* 

2*4.4  4 

22(4  * 

2344  * 

29.*  * 

9*4* 

11*.*  4 

1434  4 

141.7* 

173.7* 

19.3  * 

29.1  * 

21*4  * 

233.7  * 

247.7  * 

urn 

12*4  4 

14*4  4 

13*.*  * 

174.7  * 

19.4  * 

2*4.1  4 

21*. 4  4 

232.5  * 

244.3  * 

ton 

194  4 

1444  4 

137.2  * 

1744  * 

19.4* 

29.1  * 

217.3  * 

231.4  * 

243.3  * 

21444 

194  4 

143.4  4 

19.4  * 

173.2* 

1*7.7  * 

29.1  * 

214.3  * 

29.3  * 

244.1  * 

21414 

127.4  4 

142.7  4 

137.4  * 

172.4  * 

1144  * 

29.1  * 

213.2  * 

221.2* 

243.1  * 

am 

124.1  4 

1424  4 

134.*  * 

171.3  * 

1*4.1  * 

29.2  * 

214.2  * 

221.1  * 

2414  * 

am 

124.2  4 

1414  4 

154.2* 

19.7  * 

19.1  * 

19.2  * 

213.2  * 

2274  * 

241.7  * 

mst 

194  4 

141.7  4 

19.4* 

14*.*  * 

19.2  * 

194  * 

212.2  * 

2244  * 

237.4  * 

22323 

'  123.1  • 

141.1* 

19.7* 

147.2  * 

19.4  * 

1*7.4  * 

211.2  * 

224.1  * 

29.3  * 

214*5 

1244  4 

137.4  * 

194  * 

ttt.4  * 

194  * 

1*4.3  * 

21*. 3  * 

223.*  * 

237.4  * 

mu 

123.*  4 

19.7* 

194  * 

147.4  * 

1*1.7  * 

19.4  * 

29.3  * 

222.*  * 

234.3  * 

22S38 

123.4  4 

19.1  * 

132.4  * 

144.** 

19.*  * 

19.7  * 

29.4  * 

221.*  * 

233.2  * 

2911 

1224  4 

1374* 

131.*  * 

144.1  * 

19.1  * 

194* 

2*7.4  * 

22*.*  * 

234.2  * 

2J1C 

122.3  4 

134.1  * 

131.3* 

143.4  * 

17*4  * 

194  * 

2(44  * 

21*.*  * 

233.1  * 

23333 

121.7  4 

134.3  * 

19.4  * 

144.4  * 

17*4  * 

1*2.1  * 

29.4* 

a*.»  * 

232.1  * 

23S23 

121.2  4 

133.7  * 

I4».»  * 

143.*  * 

177.7  * 

1*14  * 

29.7  * 

21(4  * 

231.1  * 

234*7 

19.7  4 

133.1  * 

14*4  * 

143.2  * 

174.1  4 

194  * 

294  * 

2174  * 

29.1  * 

mu 

19.1  4 

19.3  * 

144.4  * 

1424  • 

174.2  * 

117.4  4 

2*2.*  * 
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